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Introduction 

The  idea  of  a memory  based  on  the  notion  of  assoc latlona  is 
apparently  a very  old  one  — Anderson  and  Bower  [1973]  trace  the  idea 
back  as  far  as  Aristotle.  However,  only  in  the  last  ten  years  has  the 
associative  memory  idea  taken  a firm  hold  with  those  interested  in 
modeling  human  memory  or  providing  working  memories  for  intelligent 
computer  programs.  Yet  in  the  short  time  since  Ross  Quillian  first 
introduced  the  idea  of  a "semantic  network"  in  his  Ph.D.  thesis  [1966], 
network  models  of  Information  and  their  computer  Implementations  have 
become  rampant. 

While  Quillian 's  original  Intent  was  to  represent  the  semantics  of 
English  words  in  his  nets,  representations  that  looked  very  similar  were 
soon  being  used  to  model  all  sorts  of  non-semantic  things  (e.g. 
propositions,  physical  object  structure,  "gated  one-shot  state 
coupling").  Yet,  virtually  every  network-like  formalism  that  has 
appeared  in  the  literature  since  1966  has  at  one  time  or  another  been 
branded  by  someone  a "semantic  net".  The  possibility  of  confusion  over 
the  real  nature  of  the  network  slipped  by  virtually  unnoticed,  since 
everyone  working  in  the  area  already  "knew"  what  it  was  that  they  were 
working  with.  But  as  interest  has  developed  over  the  last  two  years  in 
the  semantics  of  the  semantic  net  itself,  the  epistemological  status  of 
the  representation  has  become  increasingly  suspect.  This  paper  is  an 
attempt  to  clear  up  what  it  is  that  we  mean  when  we  call  our 
representations  "semantic  nets",  and  to  examine  what  claims  about  the 
structure  of  knowledge  these  so-called  "representations"  actually  make. 

To  this  end,  1 will  first  examine  the  history  of  semantic  networks, 
covering  as  broadly  as  possible  in  a limited  space  the  major 
developments  in  associative  memory  models  from  1966  through  the  present. 
I will  then  attempt  to  explain  why  so  many  of  the  earlier  formalisms  are 
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Inadequate  in  several  ways,  and  why  the  more  recent  ones  approaching 
complete  logical  adequacy  are  perhaps  not  as  useful  for  knowledge 
representation  as  it  was  hoped  they  might  be.  The  substance  of  this 
analysis  will  be  a close  look  at  the  kinds  of  entities  chosen  by 
designers  to  be  primitive  in  their  network  schemes.  By  elucidating  the 
different  kinds  of  primitives  employed  in  these  nets,  I hope  to 
illustrate  how  there  are  at  least  five  different  kinds  of  knowledge  that 
have  become  confusingly  called  "semantic"  by  their  association  with 
"semantic"  networks.  For  the  purposes  of  the  analysis,  I will  postulate 
and  discuss  five  "levels"  of  semantic  net  primitive  corresponding  to 
these  kinds  of  knowledge  — the  "implementational" , "logical", 
"epistemological",  "conceptual",  and  "linguistic"  levels. 


One  of  these  levels  has  been  less  used  and  understood  than  the 
others,  but  may  have  significantly  more  utility  in  the  near  future  for 
general  knowledge  representation  tasks  than  those  others.  This  is  the 
"epistemological"  level  of  knowledge  representation  — the  one  on  which 
several  new  non-network  formalisms  like  KRL  [Bobrow  and  Winograd  1977] 
and  FRL  [Goldstein  and  Roberts  1977,  Roberts  and  Goldstein  1977]  are 
built,  and  the  one  dealing  with  things  like  "inheritance", 

"abstraction",  concept  structuring,  etc.  In  the  third  section  of  this 
paper,  I examine  some  of  the  implications  of  this  level  of  thinking,  and 
show  how  it  has  Influenced  my  own  work  on  what  I used  to  think  of  as 
"semantic"  networks.  I will  present  some  of  the  prominent  aspects  of  a 
new  net-like  formalism  — the  "Structured  Inheritance  Network".  A 
Structured  Inheritance  Network  (SI -Net)  has  a fixed  set  of  node-  and 
link-types  (the  number  of  which  is  small),  thereby  providing  the  basis 
for  a fixed  and  well-defined  interpreter.  The  links  in  this  kind  of  net 
are  used  to  explicitly  express  "epistemological"  relationships  between 
Concepts  and  their  parts  ("Roles"  and  "Structural  Descriptions")  ~ that 
is,  structuring  relationships  between  formal  objects  used  to  represent 
knowledge.  Si-Nets  can  be  used  to  Illustrate  the  level  of  concern  of 
epistemological  formalisms  in  general,  and  I will  use  a particular 
Si-Net  langu2ige,  called  "KLONE",  to  help  elucidate  some  of  the 
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representational  responsibilities  of  such  formalisms. 

1.  A Look  at  the  Evolution  of  Semantic  Networks 

The  last  ten  years  have  seen  a tremendous  explosion  in  the  number  of 
efforts  directed  toward  developing  memory  models  which  might  be 
considered  networks,  emd  the  literature  has  expanded  to  the  point  where 
only  with  extreme  effort  can  one  maintain  familiarity  with  the  entire 
field.  To  treat  fairly  all  of  the  work  that  has  led  to  our  current 
state  of  knowledge  about  network  knowledge  representation  would  be  a 
Herculean  task,  and  one  requiring  far  more  space  and  time  than  is 
convenient  here.  Therefore,  my  analysis  will  begin  with  Ross  Qulllian's 


[1966]  work,  and  will  not  discuss  the  many  earlier  efforts  of  Gestalt 
psychology,  perception-by-reconstruction  theories  (especially  [Bartlett 
1967]  and  [Neisser  1967]),  and  Artificial  Intelligence  that  have  had 
significant  effects  on  the  current  shape  of  semantic  nets.  1 will  only 
briefly  outline  the  various  major  contributions  to  the  semantic  network 
literature,  and  hope  that  the  bibliography  at  the  end  of  this  report 
will  provide  sufficient  direction  for  the  reader  more  interested  in 
historical  trends  and  details  on  the  representations  sketched  here.  I 
will  not  proceed  strictly  chronologically  (many  of  these  projects 
developed  simultaneously) , but  will  instead  broadly  outline  three  major 
groups  of  work  — the  early  nets  that  provided  the  basic  structure, 
those  which  attempted  to  Incorporate  linguistic  case  structure,  and 
several  more  recent  important  foundational  studies. 


1.1.  The  early  nets 

The  idea  of  a "semantic  network"  representation  for  human  knowledge 
is  generally  acknowledged  to  have  originated  in  the  work  of  Ross 
Quillian  [1966,  1967,  1968,  1969,  Bell  and  Quilllan  1971];  Quillian 
proposed  an  associatlonal  network  model  of  "semantic  memory"  in  his 
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Ph.D.  thesis  in  1966.  His  Intent  was  to  capture  In  a formal 
representation  the  "objective"  part  of  the  meanings  of  words  so  that 
"humanlike  use  of  those  meanings"  would  be  possible  [1966,  p.  1].  The 
representation  was  composed  of  interconnected  by  various  kinds  of 

associative  links,  and  closely  reflected  the  organization  of  an  ordli..ary 
dictionary.  The  nodes  were  to  be  considered  "word  concepts",  and  links 
from  a concept  node  pointed  to  other  word  concepts  which  together  made 
up  a definition.  Just  as  dictionary  definitions  are  constructed  from 
sequences  of  words  defined  elsewhere  in  the  same  volume.  The  structure 
thus  ultimately  became  an  interwoven  network  of  nodes  and  links. 


In  Qulllian's  structure,  each  word  concept  node  was  considered  to  be 
the  head  of  a "plane"  which  held  its  definition.  Figure  1 [Qulllian 
1968,  p.  236]  illustrates  a set  of  three  planes  (indicated  by  solid 


Figure  1.  Qulllian's  "planes". 
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boxes)  for  three  senses  of  the  word,  "plant".  Pointers  within  the  plane 
(the  solid  links  in  the  figure)  are  those  which  form  the  structure  of 
the  definition;  Quillian  postulated  a small  set  of  these,  which 
included  subclass  (e.g.  the  relationship  of  PLANT2  to  APPARATUS  in  the 
figure),  modification  (e.g.  APPARATUS  is  modified  by  the  USE 
structure),  dislunctlon  (labeled  by  "OR"),  conlunction  (labeled  by 
"AND"),  and  3ub1ect/ob1ect  (e.g.  the  parallel  links  from  USE  to  PEOPLE 
(the  subject)  and  to  =A  (the  object)).  Pointers  leading  outside  the 
plane  (the  broken  links  in  the  figure)  indicate  other  planes  in  which 
the  referenced  words  are  themselves  defined.  The  fact  that  in 
Quillian 's  structure  words  used  in  definitions  of  other  words  had  their 
own  planes,  which  were  pointed  to  by  place-holder  nodes  within  the 
definition,  corresponded  to  the  important  "type/token"  distinction. 

Each  word  was  defined  in  only  one  plane  in  the  structure  (the  head  of 
the  plane  being  the  "type"  node),  and  all  references  to  a word  went 
through  intermediate  "token"  nodes.  Thus  definltiom^  were  not  repeated 
each  time  a word  concept  was  referenced. 

Quillian 's  desire  of  his  semantic  memory  model  was  that  it  might 
serve  as  a general  inferential  representation  for  knowledge.  He 
presented  in  his  thesis  several  examples  of  an  inference  technique  based 
on  the  notion  of  a spreading  activation  intersection  search  — given  two 
words,  possible  relations  between  them  might  be  inferred  by  an  unguided, 
breadth-first  search  of  the  area  surrounding  the  planes  for  the  words; 
this  search  was  carried  out  by  a propagation  of  some  kind  of  activation 
signal  through  the  network.  A search  would  fan  out  through  links  from 
the  original  two  planes  to  all  planes  pointed  to  by  the  originals,  until 
a point  of  intersection  was  found.  The  paths  from  the  source  nodes  to 
the  point  of  contact  of  the  two  "spheres  of  activation"  formed  by  the 
search  would  indicate  a potential  relationship  between  the  two  word 
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conceptsd).  Qullllan  hoped  that  In  this  way,  information  Input  in  one 
frame  of  reference  might  be  used  to  answer  questions  asked  in  another. 
The  use  of  information  implicit  in  the  memory,  but  not  stated 
explicitly,  was  one  of  the  Important  features  of  the  memory  model. 

Part  of  the  reason  that  certain  properties  could  be  inferred  from 
such  a memory  was  its  use  of  a link  indicating  a "subclass"  relationship 
and  a link  specifying  a "modifies"  relation.  A concept  could  be  defined 
in  terms  of  a more  general  concept  (of  which  it  was  a subclass)  and  a 
modifying  property,  which  was  a combination  of  an  attribute  and  a 
particular  value  for  that  attrlbute{2} . In  this  characterization, 
properties  true  of  a class  were  assumed  true  of  all  of  its  subclasses, 
except  for  the  modifications.  As  a result,  the  superclass  chain 
extending  upward  from  a concept  embodied  all  of  the  properties  true  of 
that  concept.  Thus  the  semantic  net  represented  the  combination  of  two 
important  types  of  memory  feature  — a superclass-subclass  taxonomic 
hierarchy,  and  the  description  of  properties  (attribute/value  pairs)  for 
each  class.  Earlier  work  done  by  Lindsay  (see  [Lindsay  19731  for  a 
later  discussion  of  Lindsay's  original  work)  and  Raphael  [1968]  can  be 
seen  to  be  the  precursors  of  this  Important  marriage. 

Qullllan  later  cleaned  up  his  memory  model  a bit.  He  eliminated  the 
type/token  distinction  by  making  everything  in  the  net  a pointer,  and, 
in  a project  called  the  "Teachable  Language  Comprehender"  (TLC)  [1969]| 
he  investigated  its  utility  as  a knowledge  base  for  the  reading  of  text. 
In  TLC,  a property  was  formally  defined  to  be  an  attribute  (some 
relational  concept),  a value,  and  possibly  some  further  "subproperties" . 
Properties  were  used  in -the  definitions  of  "units",  tdiich  represented 
the  concepts  of  objects,  events,  ideas,  assertions,  etc.:  a unit  was 
defined  by  its  superset  and  a set  of  refining  properties.  For  reading. 


{1}  The  belief  that  properties  of  a node  could  be  found  by  an  expanding 
search  led  Qullllan  to  the  idea  that  a word  concept's  "full  meaning" 
comprised  everything  that  could  be  reached  from  the  patriarchal  type 
node  (the  head  or  its  defining  plane)  by  aui  exhaustive  tracing  process. 

{2}  Qullllan  claimed  that  his  nodes  corresponded  "to  what  we  ordinarily 
call  'properties'"  [1966,  p.  26]. 
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an  Intersection  technique  was  used  to  find  relations  between  words 
encountered  in  a text  (this  was  augmented  by  the  application  of  certain 
"form  tests"  as  syntax  checks).  Figure  2 [Quiilian  1969.  p.  462] 


Figure  2.  A TLC  unit. 

illustrates  a simple  unit.  The  unit  being  defined  in  this  figure  is  the 
one  for  "client".  The  unit  indicates  that  a CLIENT  is  a PERSON  (i.e. 
PERSON  is  its  superset),  with  a further  qualification  indicated  by  the 
second  pointer  from  the  unit  to  a restricting  property.  That  property 
combines  the  "attribute",  EMPLOY,  with  a value,  PROFESSIONAL,  and  the 
subproperty,  "BY  the  CLIENT". 

While  TLC  was  an  interesting  model  for  finding  connections  between 
word  meanings,  its  success  in  reading  was  limited.  TLC's  failure  to 
achieve  understanding  was  at  least  in  part  due  to  its  insufficient  set 
of  link  types  and  the  fact  that  the  search  did  not  take  into  account  the 
meanings  of  the  various  links.  Despite  the  many  shortcomings  of  his 
model,  however,  Quiilian 's  early  papers  contain  the  seeds  of  most  of  the 
Important  ideas  that  are  today  the  mainstays  of  semantic  nets. 

Quiilian* s revised  TLC  format  gave  rise  to  two  other  important 
studies.  With  Allan  Collins,  Quiilian  undertook  a series  of  experiments 
to  test  the  psychological  plausibility  of  his  network  scheme  [Collins 
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and  Qullllan  1969,  1970a,  1970b,  1972a{3}],  and  the  networks  they  used 
to  check  reaction  time  are  easily  recognized  as  the  direct  forerunners 
of  recent  networks  (see  Fig.  3 [Collins  and  Quillian  1970a,  p.  305]). 


rink 
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Figure  3-  A simple  hierarchy. 

The  nets  were  simple  superset  hierarchies  of  concepts  like  "Animal” , 
"Bird",  and  "Canary",  with  each  node  having  attached  a set  of  properties 
defining  its  corresponding  concept  (e.g.  "has  skin",  "has  wings”,  "is 
yellow",  etc.).  Since  more  general  properties  were  supposedly  stored 
higher  up  the  generalization  hierarchy,  one  would  expect  it  to  take  more 
time  to  affirm  a statement  like  "A  canary  has  skin”  than  one  like  "A 
canary  is  yellow."  The  reaction  time  studies  seemed  to  confirm  the 
plausibility  of  a hierarchical  model  for  human  memory,  although  not 
conclusively.  In  any  case,  the  experiments  crystallized  the  notion  of 
inheritance  of  properties  in  a semantic  net  (the  passing  of  values  like 
"has  skin"  from  the  general  concept  "Animal"  to  the  more  specific 
"Canary"),  and  gave  rise  to  a concrete  notion  of  semantic  distance 
between  concepts  (l.e.  the  number  of  links  to  be  traversed  between  two 
nodes).  More  recently,  Collins  and  Loftus  [1975]  have  discussed  in  much 
detail  the  psychological  implications  of  an  extended  version  of  this 
model,  and  have  examined  some  experimental  results  in  regard  to  their 


(3)  The  reader  is  also  referred  to  an  Interesting  article  by  Collins  and 
Qullllan  called  "How  to  make  a language  user"  [ 1972b] , in  which  they 
summarize  many  of  the  things  that  they  learned  from  their  experiments 
about  language  and  memory. 
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"spreading-activation"  theory  of  processing  (a  sophistication  of 
Quillian's  semantic  intersection  technique).  The  reader  is  referred  to 
that  paper  for  some  clarification  of  Quillian's  original  theory  and  a 
defense  of  the  original  experiments. 

The  other  significant  project  arising  directly  from  Quillian's  TLC 
work  was  established  by  Carbonell  [1970a,  1970b]  and  attempted  to  use 
Quillian's  networks  as  a data  structure  in  an  Implemented  computer-aided 
Instruction  program.  The  SCHOLAR  program  had  a knowledge  base  which 
described  in  network  terms  the  geography  of  South  America.  A student 
could  participate  in  a "mixed- initiative"  dialogue  with  the  system, 
asking  and  being  asked  questions  about  the  data  base. 

SCHOLAR'S  data  base  made  some  Important  new  contributions  to 
Quillian's  nets.  Carbonell  began  to  distinguish  "concept  units"  (like 
LATITUDE)  from  "example  units"  (like  ARGENTINA),  setting  the  stage  for 
the  later  notion  of  lnstantiatlon{4} . In  addition,  a notion  of 
Quillian's  called  "tags"  was  expanded  and  used  extensively.  Figure  4 
[Carbonell  1970b,  p.  194]  illustrates  the  SCHOLAR  units  for  latitude  and 
Argentina;  in  the  text  part  of  the  figure,  the  name  of  a unit  follows 
"RPAQQ"  (a  LISP  value-setting  function),  and  anything  within  the  unit 
that  follows  a left  parenthesis  is  an  attribute.  Tags  on  relations  are 
indicated  by  parenthesized  pairs  following  the  attribute  names  (e.g.  the 
"SUPERP"  of  LATITUDE  is  LOCATION,  and  has  the  tag  "(I  2)").  The  most 
important  of  the  tags  in  SCHOLAR  was  the  "irrelevancy  tag"  ("I-tag"), 
which  could  explicitly  Increase  the  semantic  distance  between  two  nodes. 
I-tags  were  used  to  determine  the  relevance  of  certain  facts  in  a given 


(4)  Instantiation  has  become  one  of  the  most  well-known  aspects  of 
semantic  net  formalisms.  The  general  idea  is  the  association  of  a 
particular  individual  with  the  class  of  which  it  is  a member,  and  in 
most  notations,  this  is  reflected  by  the  construction  of  an  individual 
description  based  on  a generic  description  that  the  individual 
satisfies.  Thus,  while  we  primarily  think  of  instances  as  things  ^ the 
world  which  are  manifestations  of  our  abstract  concepts,  the  term 
"instantiation"  is  very  often  used  to  refer  to  the  production  of  a 
desGriptlon  of  an  individual  based  on  a more  general  description.  I 
will  later  (Section  3)  use  the  term,  "individuation"  (of  description) 
for  this  latter  Intent,  avoiding  the  potential  confusion  over  what  the 
term  "instance"  really  means. 
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Figure  4.  SCHOLAR  units. 


context,  and  allowed  the  system  to  start  with  the  most  relevant  aspects 
of  a unit  when  describing  a concept  to  the  student.  In  addition, 
SCHOLAR  Introduced  temporary,  time-dependent  tags.  Also,  while 
SCHOLAR'S  units  looked  much  like  Quillian's  TLC  units,  the  properties 
associated  with  a unit  had  as  their  first  elements  the  names  of 
attributes,  rather  than  pointers  (resurrecting  the  type/token 
distinction) . Thus  the  precedent  was  set  for  naming  links  — 
associating  arbitrary  labels  with  the  associations  between  units.  In 
addition  to  several  special  attributes  ("SUPERC"  for  superconcept, 
"SUPERP"  for  superpart,  and  "SUPERA"  for  superattribute),  things  like 
"LOCATION",  "TOPOGRAPKI" , "CITIES",  "UNIT",  etc.  were  now  being  encoded 
directly  into  the  network{5}.  Another  important  precedent  set  in  the 
SCHOLAR  net  was  the  intermixing  of  procedures  with  the  declarative 
structure.  LISP  functions  associated  with  units  were  used  to  actively 


(5)  Vlhile  Carbonell  claimed  that  no  links  were  privileged  [1970a,  p. 
112],  that  those  like  "superc"  are  very  special  indeed  is  illustrated  in 
[Brachman  1978b]. 
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infer  properties  that  were  not  stated  as  declarative  facts. 

Another  early  effort,  which  proceeded  independently  of  the 
Quillian/SCHOLAR  work  but  made  use  of  similar  structures,  was  Winston's 
"structural  descriptions”  work  at  M.l.T.  [1970,  1975].  Winston  created 
a program  that  could  infer  the  "concept"  of  a physical  structure  such  as 
an  ARCH  (see  Fig.  5 [Winston  1975,  p.  198]),  given  encodings  of  a set  of 


MOOIF|CATlON-OF 


CROUP- OF 


HAS-PROPCRTV-OF 


SUPPORTED -BY 


IIMI 


RELATION 


Figure  5.  Structural  description  of  an  ARCH. 

examples  of  the  structure  in  a network  description  language.  The 
descriptions  included  nodes  for  concepts  of  physical  objects  (like 
BRICKs)  in  a scene,  and  labeled  links  representing  physical 
relationships  between  the  objects  (e.g.  LEFT-OF,  SUPPORTBD-BY ) . The 
interesting  thing  about  Winston's  networks  (aside  from  the  fact  that  he 
had  actually  written  a program  to  Induce  generalizations  from  them)  is 
that  the  relationships  between  concepts  could  themselves  be  modified  or 
talked  about  as  concepts.  For  example,  in  the  very  same  notation,  B 
could  be  described  as  LEFT-OF  C,  and  LEFT-OF  described  as  OPPOSITE 


BBN  Report  No.  3807 


Section  1.2 


RIGHT-OF.  Winston  also  used  the  s^une  language  as  his  cooparlson  j 

language  for  determining  differences  between  examples.  < 

One  problem  with  Winston's  notation,  as  with  each  of  the  others  I 

mentioned  so  far,  was  its  complete  uniformity.  While  the  notions  of 
superconcept  and  instance  were  included  in  these  nets,  there  was  no  i 

acknowledgement  of  their  difference  from  domain-specific  notions  like  ‘ 

location  and  support.  One  could  not  "see"  a hierarchy  by  looking  at  the  ^ 

structure,  and  Important  notions  like  inheritance  were  obscured  by  an  | 

overly  uniform  mixture  of  domain-specific  and  general  "properties". 

However,  with  the  groundwork  laid  by  Quilllan,  Collins,  Carbonell,  and 
Winston,  almost  all  of  the  semantic  net  apparatus  used  in  the  '70's  is 
already  accounted  for,  and  very  little  has  really  changed  since  then 
(until  very  recently,  as  Section  3 will  attempt  to  show). 

1.2.  Case  structures  . 

The  work  of  Chas.  Fillmore  on  linguistic  case  structure  [1968] 
helped  focus  network  attention  onto  verbs.  Those  interested  in 
processing  natural  language  with  semantic  nets  began  to  think  of  a 
sentence  as  a modality  coupled  with  a proposition,  where  a modality 
captured  information  such  as  tense,  mood,  manner,  and  aspect,  and  a 
proposition  was  a verb  and  a set  of  filled-ln  cases.  There  were 
believed  to  be  a reasonably  small  number  of  cases  (i.e.  relationships  in 
which  nomlnals  could  participate  relative  to  the  verb  of  a sentence) , 
and  several  people  set  out  to  Incorporate  this  belief  in  network 
formalisms.  The  fact  that  properties  in  semantic  nets  were  clustered 
around  nodes  made  the  nodes  ideal  places  to  anchor  cases  — if  a node 
were  thought  of  as  a verbal  concept,  its  associated  attribute/value 
pairs  could  easily  be  case/filler  pairs. 

Simmons,  ^ [Simmons,  Burger  and  Schwarcz  1968,  Simmons  and  . 

Bruce  1971,  Simmons  and  Slocum  1972,  Simmons  1973i  Hendrix,  Thompson  and  | 

Slocum  1973]  used  this  notion  very  early  in  work  that  developed  from  the 
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older  "Protoaynthex”  system.  Simmons'  networks  became  centered  around 
• i verbal  nodes,  with  pointers  labeled  with  case  names  to  the  participants 

in  the  action  represented  by  the  node  (see  Fig.  6 [Simmons  and  Bruce 
1971,  p.  525]  — the  verbal  node  here  is  Cl,  a TOKen  of  the  verb. 


Figure  6.  A Simmons  case  structure. 

"Make").  The  verbs  themselves  were  grouped  into  "paradigms",  according 
to  the  sets  of  case  relations  in  which  they  participated. 

Simmons'  networks  focused  on  the  understanding  and  generation  of 
particular  sentences  — not  much  attention  seems  to  have  been  given  in 
the  original  work  to  the  semantic  network  as  a hierarchical 
classification  device,  nor  to  the  place  of  general  "world  knowledge"  in 
the  overall  scheme.  Thus  no  classification  of  verbs,  or  nouns,  for  that 
matter,  existed  outside  of  the  similar  case-frame  grouping  (the 
paradigms) , and  no  definitions  of  general  concepts  seemed  to  exist  at 

t all.  Recently,  however,  some  sophistication  has  been  added  to  these 

[■  ■'  ! 

* networks,  including  substantial  use  of  superconcept  and  "Instance” 

^ links.  In  addition,  quantification  and  deductive  mechanisms  are 

: t 

I discussed  in  [Simmons  and  Chester  1977]. 

I A similar  incorporation  of  case  structures  into  a network  framework 

was  achieved  by  Rumelhart,  Lindsay,  and  Norman  [1972,  Norman  1972,  1973, 
I Norman,  Rumelhart  and  the  LNR  Research  Group  1975,  Rumelhart  and  Norman 

1973]'  Their  attempt,  spanning  several  years,  included  many  of  the 
features  that  Simmons  had  left  out,  although  their  orientation  was  more 
psychological  and  thus  dealt  with  more  aspects  of  memory.  The 
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Riunelhart,  ^ networks  Included  nodes  for  concepts,  nodes  for 
events,  and  nodes  for  episodes  — sequences  of  events  clustered 
together.  General  definitions  of  concepts  in  the  network  were  encoded 
in  a straightforward  manner,  with  case-like  pointers  indicating  parts  of 
nominal  concepts  and  agents  and  objects  of  verbs,  as  Illustrated  in  Fig. 
7 [Rumelhart,  Lindsay  and  Norman  1972,  p.  224].  Unfortunately,  their 


■ALLOON 


Figure  7.  Some  Rumelhart,  ^ concepts. 

notation  was  also  very  uniform,  so  that  all  links  looked  the  same.  In 
addition,  the  infamous  "ISA"  link  (see  [Woods  1975]  and  [Cercone  1975]) 
was  used  to  indicate  type-token  relations  as  well  as  subset  relations, 
and  many  other  relations  were  not  motivated  or  explained  — the  English 
mnemonics  are  all  that  we  have  to  indicate  their  semantics.  Relatively 
little  attention  was  given  to  the  structure  at  the  foundational,  logical 
adequacy  level,  so  that  the  inheritance  relations  between  concepts  were 
not  always  clear. 

On  the  other  hand,  the  Rumelhart  and  Norman  group  made  an  effort  to 
account  for  procedural-type  information  directly  in  their  notation 
(using  a link  called  "ISWHEN"),  and  Integrated  case-type  information 
with  other  "world  knowledge".  They  included  definitional  as  well  as 
instantiated  (propositional)  constructs,  and,  all  in  all,  they  have 
captured  many  good  ideas  in  their  nets. 

Another  important  piece  of  work  that  deserves  at  least  brief  mention 
here  is  Schank's  "conceptual  dependency"  representation  [1972,  1973a, 
1973b,  Schank,  Goldman,  Rieger  and  Riesbeck  1973].  While  Schank  himself 
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does  not  seem  to  believe  in  semantic  memory  [1974,  1975],  his 
conceptualizations  very  much  resemble  concepts  In  systems  like  Simmons' 
and  Rumelhart  and  Norman's,  as  evidenced  In  Fig.  8 [Schank  1973b,  p. 
201].  A conceptualization  consists  of  a primitive  act  and  seme 
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mouth 
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Figure  8.  A conceptual  dependency  conceptualization. 

associated  cases,  like  "Instrument",  "direction",  etc.  In  conceptual 
dependency  diagrams,  arrows  with  different  shapes  and  labels  Indicate 
the  case  relations.  For  example.  In  Fig.  8 the  "R"  relation  (a  three- 
pronged arrow)  Indicates  the  recipient  case,  while  the  "1"  relation 
Indicates  the  Instrument  of  the  conceptualization  (one  Interesting  Idea 
that  Is  Illustrated  here  Is  that  the  Instrument  of  an  action  Is  Itself  a 
conceptualization).  Each  primitive  act  (e.g.  "TRANS",  "INGEST")  has  a 
particular  case  structure  associated  with  It,  and  the  higher- level  verbs 
that  one  sees  In  the  other  notations  must  be  broken  down  Into  canonical 
structures  of  primitives  here.  Thus,  not  only  does  Schank  specify  a set 
of  primitive  relations,  he  suggests  a set  of  knowledge  primitives  out  of 
which  concepts  should  be  built  (this  is  In  contrast  to  what  we  shall 
later  refer  to  as  "epistemological  primitives",  operations  for 
structuring  pieces  of  the  representation).  Schank' s contribution  to  the 
study  of  knowledge  representation,  while  controversial,  is  an  Important 
one.  His  cases  are  "deeper"  than  those  of  Simmons,  and  begin  to  attack 
knowledge  structure  at  the  primitive  level.  Conceptual  dependency  was 
Incorporated  as  the  memory  structure  of  the  MARGIE  system,  which  was  a 
natural  language  understanding  system  that  could  parse  an  Input  sentence 
Into  the  deep  conceptual  structure  and  rephrase  It  In  a number  of 
different  ways.  Schank  and  Rieger  [1974]  developed  some  Important 
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inferential  properties  for  their  memory  structures,  and  their  work  has 
had  a great  influence  on  much  of  the  later  work  in  the  field.  The 
reader  should  consult  [Wilks  1974]  and  [Cercone  1975]  for  two  excellent 
expositions  of  Schank's  work. 

In  more  recent  work,  Rieger  has  attempted  to  deal  in  greater  depth 
with  the  relations  between  actions  and  states  [1975,  1976,  1977,  Rieger 
and  Grinberg  1977].  "Commonsense  Algorithms"  (CSA's)  capture  information 
of  a much  more  dynamic  sort  than  that  handled  by  the  traditional,  static 
concept  networks.  Rieger  has  nodes  that  represent  not  only  primitive 
actions,  but  states,  statechanges , wants,  and  "tendencies"  (a  tendency 
in  CSA  representation  is  a kind  of  action  that  takes  place  without  the 
effort  of  an  Intentional  force;  one  such  tendency,  for  example,  is 
gravity).  There  is  a small  repertoire  of  primitive  link  types  which  are 
used  to  represent  the  underlying  dynamic  relationships  between  the 
actions,  states,  etc.  ("ten  theoretical  forms  of  inter-event  causal 
interaction"  [Rieger  and  Grinberg  1977,  p.  250]).  CSA  links  stand  for 
relations  like  causality,  enablement,  concurrency,  and  the  like,  with 
the  primary  emphasis  on  expressing  the  cause  and  effect  relationships 
that  make  physical  systems  work.  While  the  notion  that  causality  can  be 
captured  in  a single  link  is  debatable,  CSA's  may  provide  a useful  way 
to  express  dynamic  information  that  in  other  systems  is  supposedly 
captured  by  unstructured  relational  links,  and  may  do  so  in  a ccxnplete 
enough  way  to  allow  the  simulation  of  certain  physical  mechanisms,  like 
the  reverse-trap  flush  toilet  [Rieger  1975]  and  the  reasonably  complex 
"Home  Gas  Forced-Air  Furnace"  [Rieger  and  Grinberg  1977]. 

Two  other  important  treatments  of  memory  with  verb-centered 
case-like  systems  surfaced  in  the  early  '70's.  George  Heidorn's  thesis 
[1972]  parlayed  a simple  hierarchical  network  and  instantiation 
mechanism  into  a system,  called  "NLPQ",  that  could  "understand"  a 
queuing  problem  described  to  it  in  English.  From  this  description,  NLPQ 
could  produce  both  an  English  restatement  of  the  problem  and  a complete 
program  (written  in  GPSS)  for  simulating  the  situation  described.  By 
including  in  advance  some  simple  case  frame  definitions  of  actions 
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relevant  to  queuing  situations  (for  example,  "unload"  takes  em  Agent,  a 
Goal,  a Location,  and  a Duration),  Heldorn  provided  his  system  with  a 
built-in  definitional  context  for  the  description  of  a particular 
situation.  During  an  initial  conversation  with  the  user,  the  NLPQ 
system  would  build  an  "Internal  problem  description".  This  "IPD" 


Figure  9.  Heldorn 's  "IPD". 

comprised  a set  of  Instances  connected  appropriately  to  the  general 
definitions  (see  Fig.  9 [Heldorn  197^,  p.  953).  NLPQ  could  consult 
those  definitions  and  tell  when  the  problem  description  was  Incomplete; 
It  could  thus  Intelligently  ask  the  user  for  missing  information. 
Although  Heldorn' s network  was  very  simple-minded  and  uniform  (It  was 
not  very  deep,  concepts  had  very  simple  structure,  and  the  "SUP"  link 
was  used  for  both  subconcepts  and  Instances) , he  achieved  a rather 
dazzling  effect  by  incorporating  It  In  a general  grammar-rule  language 
and  by  starting  with  a set  of  concepts  well-matched  to  the  simulation 
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language  in  which  the  output  was  produced. 

The  other  "case"  study  produced  a strongly  psychologically-oriented 
memory  structure  called  "HAM"  (for  "Human  Associative  Memory")  [Anderson 
and  Bower  1973)  1974].  The  elements  of  HAM  were  propositions,  binary 
trees  which  represented  the  underlying  structure  of  sentences.  A simple 


debutante  need  deodorant 


I Figure  10.  A HAM  proposition. 

set  membership  (the  "e"  links  in  Fig.  10)  and  subset,  some  cases  like 
subject  ("S"  in  Fig.  10),  object  ("0"),  location  ("L"),  and  time  ("T"), 
and  some  logical  indicators  like  predicate  ("P"),  "context"  ("C"),  and 
"fact"  ("F")  — all  represented  uniformly.  Propositions  in  HAM  had 

I 

truth  values,  and  were  supposed  to  convey  assertions  about  the  world; 
Anderson  and  Bower's  notation  failed  to  account  for  the  Internal 

r structure  of  nominal  entitles.  There  were  many  problems  with  this 

I 

I simple  notation,  some  of  which  are  discussed  in  Schubert  [1976],  a work 

' whose  detail  on  the  logical  structure  of  semantic  networks  in  terms  of 

predicates  and  propositions  makes  it  clear  that  HAM's  propositional 
notation  is  insufficient.  However,  Anderson  and  Bower  produced  an 
extensive  investigation  into  the  state  of  the  relevant  philosophical  and 
scientific  work  at  the  time  of  their  otm  work,  and  their  detailed 
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psychological  discussions  should  be  consulted.  Although  their  model  is 
admitted  to  be  Inadequate  and  the  semantics  of  their  representation  Is 
not  thoroughly  worked  out,  their  book  Is  a milestone  of  start-to-flnlsh 
research  In  a field  often  plagued  by  less  than  thorough  work. 


1.3.  Concern  for  the  foundations 

Unfortunately,  most  of  the  early  work  covered  above  suffers  from  a 
lack  of  explicit  acknowledgement  of  some  fundamental  principles  of 
knowledge  representation  design.  Authors  are  most  often  Intuitive  when 
describing  the  semantics  of  their  representatlons(6} , and  as  the  network 
notations  get  more  complex,  more  and  more  of  the  assumptions  are  left  to 
the  reader's  Imagination.  Most  of  the  early  representations  were  not 
extensible  In  a general  way  (l.e.  the  system  designer  must  intervene  to 
add  new  case  relations),  and  In  general,  the  combination  of  set 
operations  and  descriptive  concept  operations  that  the  semantic  net  Is 
based  upon  has  been  poorly  understood  (see  [Brachman  1978b],  especially 
Ch.  4,  for  details).  All  of  the  notations  we  have  mentioned  so  far  are 
seductively  uniform  — conceptual  relations  (e.g.  "agent",  "color", 
"left-of")  and  underlying  knowledge  mechanisms  (e.g.  "superset", 
"iswhen",  "member")  are  expressed  In  indistinguishable  terms.  In 
Section  2,  1 will  contend  that  this  homogeneity  Is  misguided  and 
confusing. 

However,  In  addition  to  that  described  In  Section  3f  some  recent 
efforts  have  set  out  to  remedy  this  inadequacy.  Among  the  more 
Important  of  the  earlier  and  concurrent  projects  that  attempted  to  deal 
with  the  expressive  Inadequacy  of  semantic  nets  are  the  work  of  Cercone 
and  Schubert  at  the  University  of  Alberta,  and  the  work  of  Levesque  and 


(6)  For  example,  "Intuitively,  the  nodes  in  the  tree  represent  ideas  and 
the  links  relations  or  associations  between  the  ideas"  [Anderson  and 
Bower  1973»  p.  139J;  "In  this  system  a large  part  of  the  information  is 
about  the  words  and  concepts  of  the  relevant  domain  of  discourse  ..." 
[Heidorn  1972,  p.  35]. 
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Myopoulos  at  the  University  of  Toronto,  to  which  we  turn  In  a aoaent. 
Several  years  earlier,  however,  Stuart  Shapiro  [1971a,  1971b]  Introduced 
the  important  distinction  between  the  "item",  or  conceptual  level  of 
network,  and  the  "system"  level  — the  structural  level  of 
interconnection  that  ties  structured  assertions  of  facts  to  items 
participating  in  those  facts  (i.e.  indicates  bindings).  System 
relations  are  the  labeled  links  in  the  network,  and  their  semantics  is 
determined  by  the  set  of  processing  routines  that  operate  on  them.  Item 
relations  are  concepts  which  happen  to  be  relational  in  nature,  and  are 
represented  by  nodes  ("items")  Just  as  are  other,  non-relational 
3 rcepts.  Thus,  a relationship  like  "LOVES"  would  appear  not  as  a link 
in  the  net,  but  as  a node.  Particular  assertions  of  the  relationship 
would  also  be  nodes,  with  AGENT  and  OBJECT  system  links  to  nodes  for  the 
participants,  and  a VERB  link  back  to  the  node  for  LOVES  (see  Fig.  11 
[Shapiro  1971a,  p.  43]  — in  this  figure,  the  top  three  nodes  are 


Figure  11.  Separating  system  relations  from  item  relations. 

assertions  of  particular  LOVES  relationships).  Shapiro  makes  no 
suggestion  as  to  how  the  general  verb  Itself  should  be  defined  in 
network  terms  (that  is,  what  makes  a concept  LOVES  as  opposed  to  any 
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other  verb  with  a similar  case  frame). 

Shapiro's  distinction  explicitly  separates  underlying  primitive 
cases  from  all  other,  conceptual  relations.  He  also  explains  how  rules 
for  deduction  can  be  encoded  directly  In  his  formalism,  and  discusses  at 
length  a language  for  doing  retrieval  from  his  network  structure.  His 
early  work  gives  us  no  guidelines  for  what  the  set  of  system  relations 
should  be  (his  examples  suggest  linguistic  cases),  nor  does  he  talk 
about  the  semantics  of  Items,  except  to  Imply  through  his  search 
mechanism  that  sets  are  Important.  Shapiro's  claim  Is  only  that  what  he 
has  given  us  Is  an  epistemologically  neutral  structure,  a general 
language  on  top  of  which  many  models  of  knowledge  might  be  constructed. 
This  In  Itself,  however,  represents  a significant  advance  over  previous 
networks  In  the  distillation  of  two  very  different  levels  of 
representation . 

Between  the  time  of  Shapiro's  thesis  [1971a]  and  the  more  recent 
work  to  which  we  have  alluded,  others  have  tried  to  resolve  some  of  the 
Inadequacies  of  the  homogeneous  standard  evolved  from  Qullllan's 
Semantic  Memory.  Hays  [1973a,  1973b],  In  his  "cognitive  networks",  has 
attempted  to  differentiate  some  of  the  semantics  of  network  notations, 
and  to  be  more  formal  than  earlier  authors  about  network  structures  (he 
specifies  four  node  types.  Including  "modalities",  and  five  major  link 
types).  Among  other  things,  his  work  has  contributed  the  distinction 
between  a "manifestation"  of  an  object  and  an  "Instance" (7). 

Hendrix  [1975a, b,  1976],  In  attempting  to  provide  an  adequate 
quantification  mechanism  for  semantic  network  concepts,  Introduced  what 
has  become  a very  broadly  utilized  facility  — "partitions" {8} , or 
formal  groupings  of  concept  nodes.  Figure  12  [Hendrix  1975a,  p.  239] 


(7)  Objects  In  Hays'  epistemology  are  permanent.  However,  they  do 
change  over  time  (e.g.  a person  Is  at  various  times  an  Infant,  a child, 
an  adolescent,  an  adult,  etc.).  Manifestations  are  different  concepts 
of  the  same  object  at  different  places  or  stages  of  Its  existence. 

(8)  Scragg  [1975]  has,  apparently  Independently,  Introduced  a very 
similar  mechanism,  which  he  calls  "planes". 
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Figure  12.  A partitioned  set  of  nodes. 

Illustrates  the  use  of  partitions  (Indicated  by  rectangular  dashed 
boxes)  to  represent  "Every  city  has  a dogcatcher  who  has  been  bitten  by 
every  dog  In  town".  In  this  figure,  the  two  larger  "spaces"  hold  the 
scopes  of  the  universal  quantifiers:  the  "form"  link  points  to  a space 
representing  the  scope  of  the  universally  quantified  variable,  which  Is 
encoded  by  a node  pointed  to  by  a "for  all  v"  link.  The  node  labeled 
"p"  Is  an  Implicitly  existentially  quantified  node,  representing  the 
particular  dogcatcher  for  any  given  town. 

Partitioning  has  many  potential  uses;  for  example.  It  can  be  used  to 
provide  a context  mechanism,  whereby  entire  areas  of  memory  may  be 
opened  up  or  sealed  off  at  relevant  times  (this  allows  reasonable 
groupings  of  beliefs).  It  should  be  pointed  out  that  the  nodes  In  many 
of  Hendrix's  nets  represent  sets  as  well  as  "prototypes",  and  the 
Introduction  of  case-llke  properties  for  concept  nodes  makes  them 
susceptible  to  the  same  confusions  as  all  of  the  older,  uniform  nets 
(this  Is  evidenced  by  relations  like  "creature"  and  "assailant"  being 
directly  encoded  as  links  In  his  nets).  Apparently,  however,  different 
space-types  are  used  to  distinguish  different  uses  of  the  same  link,  and 
the  non-loglcal  links  are  not  really  primitive  In  the  system,  they're 
being  Introduced  by  "delineations"  associated  with  general  verbal 
concepts  like  "OWNINGS".  This  Is  not  obvious  In  some  of  the  earlier 
papers,  but  see  [Hendrix  1978]  for  the  supporting  details. 
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phenomena  like  quantification,  context,  structural  "plots"  [Grosz  i977], 
etc.  When  viewed  as  a mechanism,  with  no  epistemological  claims  about 


1 their  expressive  adequacy  (which  depend  on  each  individual's  use  of 

them),  partitions  do  not  come  under  the  Jurisdiction  of  our  criticisms 
in  Section  2.  When  partitions  implement  mixed  sets  of  relationships 
(like  "creature"  and  subset),  then  they  are  open  to  the  kind  of 
' complaint  we  will  lodge  in  that  section.  That  is,  each  partition 

(space)  type  used  in  a system  is  open  to  its  own  epistemological 
constraints.  Just  as  is  each  use  of  the  simple,  general  notion  of  a 
"node" . 

In  1975  a very  important  paper  by  Wm.  Woods  appeared;  this  study  of 
"what's  in  a link"  for  the  first  time  seriously  challenged  the  logical 
adequacy  of  previous  semantic  network  notations  [Woods  19751.  Woods 

f 

I pointed  out  the  intensional  nature  of  many  of  the  things  we  call  upon 

'■  nets  to  represent  (see  also  Ch.  5 of  [Brachman  1978b]),  and  discussed  in 

I detail  several  important  challenges  for  network  notations  that  had  not 

[ been  previously  acknowledged,  let  alone  successfully  met.  We  were  asked 

[ to  begin  to  consider  the  semantics  His.  representation  itself,  and  to 

: be  held  accountable  for  things  previously  brushed  aside  under  the 

[ auspices  of  "intuition".  The  work  to  be  described  in  Section  3 is  to 

' some  extent  a broader  and  deeper  Investigation  in  the  same  spirit  as  the 

Woods  paper,  a continuation  of  the  semantic  investigative  work  only 
begun  there.  It  is  hoped  that  many  of  Woods'  challenges  have  been 
overcome  by  the  structures  illustrated  in  that  section  and  in  [Brachman 
I 1978b]. 

Some  of  the  issues  raised  by  Woods  — the  more  logically  oriented 
' ones  — have  been  recently  treated  in  a series  of  papers  by  Cercone  and 

^ Schubert  [1975,  Cercone  1975,  Schubert  1976].  In  their  attempts  to 


extend  the  expressive  power  of  network  notation,  Schubert  and  Cercone 
have  expended  considerable  effort  in  the  investigation  of  the  underlying 

onnheni-.  nf  the  nnr!e_n1  iin— 1 I nV  fnrmflil.am.  Manv  of  the  1 nniien  of 
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knowledge  representation  that  were  emphasized  In  my  thesis  [Brachman 
1978b]  were  raised  In  various  papers  from  Alberta;  In  particular,  an 
excellent  criticism  of  the  naive  notion  of  the  existence  of  a small 
number  of  "conceptually  primitive  relations"  (l.e.  cases)  reflects  a 
similar  Intuition  about  roles  (see  Section  5.1.3>1  of  [Brachman  1978b], 
[Schubert  1976,  pp.  168-170],  and  [Cercone  1975,  pp.  79-80]). 

The  notation  developed  by  Schubert  and  Cercone  Is  propositional  — 
an  Important  basic  node  type  In  the  network  Is  the  predicative  concept 
node,  which  Is  Instantiated  by  conjoining  at  a proposition  node  a 
pointer  to  the  predicate  and  a pointer  to  each  argument  of  the  predicate 
(see  Fig.  13  [Cercone  1975,  p.  36]).  The  links  used  are  all  predefined 


^CjookT) 


«ary  Q 


Figure  13.  A proposition  node. 

system  links,  used  only  to  point  out  the  particular  predicate  Invoked 
and  to  order  the  arguments.  All  of  the  conceptual  work  Is  done  by  the 
particular  predicates  pointed  to  with  "FRED"  links  from  the  proposition 
nodes.  Schubert  and  Cercone  claim  also  to  have  concept  nodes  for 
individuals  and  sets,  although  it  is  not  clear  from  the  notation  where 
these  Interpretations  are  expected.  Given  the  propositional  nature  of 
the  notation,  a series  of  logical  connectives  and  quantification 
conventions  can  be  unambiguously  (and  explicitly)  represented.  In 
addition,  Schubert  and  Cercone  provide  facilities  for  lambda-abstraction 
and  various  other  Intensional  operations,  and  include  time  primitives 
for  certain  types  of  predicates.  Schubert  [1976]  discusses  the  clear 
correspondence  of  his  notation  to  predicate  calculus,  providing  for  the 
first  time  a clear  standard  of  reference  for  network  (logical) 
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While  the  work  of  Cercone  and  Schubert  begins  to  answer  some  of  the 
questions  raised  in  Woods'  paper,  theirs  is  still  only  a neutral  logical 
language.  This  notation,  as  all  others  discussed  so  far,  offers  no 
guidelines  to  its  users  on  how  to  structure  concepts  in  terms  of  the 
primitives  of  the  notation.  The  language  is  as  general,  uniform,  and 
low-level  as  predicate  calculus  and  it  is  up  to  the  designer  of  the 
particular  network  how  to  structure  his  world  in  terms  of  predicates  and 
propositions.  While  Schubert's  notation  un^unbiguously  accounts  for  many 
of  the  underlying  logical  operations  of  the  semamtic  network,  something 
more  seems  to  be  needed  for  it  to  be  a truly  useful  representation  of 
knowledge.  This  seems  to  Involve  looking  at  network  structures  at  a 
slightly  "higher"  level. 

Some  hints  on  higher  level  primitives  have  been  afforded  us  by  some 
more  recent  efforts  in  network  formalisms.  Fahlman  [1977]  has  designed 
a network  system  comprising  two  major  parts:  a parallel  memory  scheme, 
which  allows  propagation  of  markers  through  a network  composed  of 
special-purpose  hardware;  and  a language  (called  NETL)  for  representing 
knowledge  on  top  of  the  parallel  memory.  There  are  several  Important 
things  to  note  about  Fahlman 's  work.  His  is  perhaps  the  first  attempt 
to  account  for  network- implementing  hardware  in  its  own  right.  The 
marker  propagation  and  detection  mechanism  eliminates  much  of  the  costly 
search  intrinsic  to  previous,  non-parallel  systems.  Further,  he 
Introduces  the  idea  of  a "virtual  copy"  as  a dominant  organizing 
concept.  This  is  a convenient  way  to  think  about  inheritance  in 
semantic  nets,  since  it  lets  us  assume  that  all  properties  at  a parent 
node  are  (virtually)  available  at  its  subnodes.  When  a real  copy  is 
needed,  as,  for  Instance,  when  a property  is  to  be  explicitly  modified, 
Fahlman  has  us  create  a "MAP-node".  The  parallel-processing  scheme 
makes  virtual  copy  and  map  links  act  as  short-circuits  in  the 
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appropriate  circumstances,  thereby  allowing  any  Inherited  definitions  to 
be  immediately  available.  j 

Further,  Fahlman  introduces  the  "role"  as  a type  of  individual, 
whose  universe  of  existence  is  another  concept.  While  he  at  times,  1 
believe,  confuses  the  notion  of  a functional  role  (like  "AGENT")  with 
that  of  a role  filler  (like  "PERSON"),  he  seems  to  be  on  the  right  track 
in  terms  of  the  structure  of  concepts.  In  my  own  work  (see  Section  3)> 

I have  found  this  role  notion  to  be  critical,  and  have  what  amount  to 
MAP-nodes  also.  A good  deal  of  Fahlman' s foundations  could  be  used  to 
support  other  network  schemes. 

"Role-nodes"  as  parts  of  structured  descriptions  also  constitute  a 
critical  element  in  the  work  of  Philip  Hayes  [ 1977a, b].  Hayes’  networks 
have  two  levels  of  structure.  Just  as  those  to  be  presented  in  Section  3 
have;  the  internal  structure  of  "depictions"  (concepts),  and 
relationships  between  depictions  as  wholes.  Briefly,  a depiction 
expresses  the  structure  of  an  entity  through  a set  of  PARTOF  and 
CONNECTED  relationships  between  other  entitles  that  make  up  its  parts. 

For  example,  in  Fig.  14  [Philip  Hayes  1977a,  p.93]i  the  depiction 
"D-HUMAN"  (indicated  by  dotted  lines)  partially  expresses  the  structure 
of  a human  (represented  by  the  node,  N-HUMAN)  in  terms  of  an  ARM  and  a 
TORSO.  In  the  depiction,  D-HUMAN,  N-ARM  acts  as  a depict£i:;  at  the  same 
time,  in  D-ARM,  N-ARM  is  the  depictfifi  - the  subject  of  the 
depictloni 10} . Thus,  tdille  it  is  a thing  unto  itself  in  one  structure, 
it  acts  as  the  specifier  of  a role  to  be  filled  in  another.  In  some 
cases,  Hayes  contends  (and  1 concur),  the  role  can  only  exist  within  the 
larger  context.  For  example,  an  arm  cannot  exist  without  implying  the 
existence  of  some  human;  in  that  case,  N-ARM  would  be  an  "SQNODE"  for 
D-HUMAN,  and  the  dependency  would  be  expressed  in  an  "SQN  structure" 

(for  sine  qua  non)  involving  D-ARM  and  D-HUMAN. 

(10)  While  N-ARM  is  the  same  node  in  both  depictions,  links  to  it  are 
only  "visible"  from  the  depiction  from  which  it  is  viewed.  That  way 
various  uses  of  ARM  from  more  than  one  context  can  be  kept  distinct. 
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Figure  1M.  Hayes'  depictions  and  binders. 

While  Hayes  does  not  distinguish  the  role  Itself  from  the  role 
filler  (see  Section  3),  and  "CONNECTED"  Is  much  too  simplistic  to 
capture  relations  between  roles,  the  very  fact  that  Hayes  has  roles  at 
all  Is  significant.  Concept  structure  Involving  roles  Is  strictly 
enforced  In  Instantiation,  using  a structure  called  a "binder".  In  Fig 
1M,  there  are  two  binders  (Indicated  by  the  rectangular  boxes,  the 
arrows  coming  in  to  them,  and  the  dots  at  Intersections),  representing 
"Fred"  and  "Fred's  arm".  The  binder  captures  the  fact  that  roles  are 
Inherited  ^ cart  of  ^ structure . There  are  explicit  connections 
between  role  definitions  (In  the  depictions)  and  role  flller/lnstance 
pairs  (In  the  binders).  Just  as  I propose  In  Section  3 (although  the 
exact  nature  of  the  relationships  Is  not  spelled  out  In  Hayes' 
structure).  The  explicit  acknowledgement  of  these  relationships  Is  a 
very  Important  development  In  the  history  of  semantic  networks. 

Finally,  a Joint  concern  for  higher-level  (non-loglcal)  structures 
and  their  semantics  In  a semantic  network  formalism  has  surfaced  In  the 
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work  of  Levesque  and  Mylopoulos  at  Toronto  [1978,  Levesque  1977].  Their 
efforts  attempt  to  provide  a procedural  semantics  for  the  relations  In  a 
network  by  associating  with  a class  (concept)  a set  of  four  operations: 
add  an  instance,  remove  an  Instance,  fetch  all  Instances  of  the  class 
and  test  for  being  an  instance  of  the  class.  Classes  are  given  Internal 
structure  with  slots;  parts  fill  these  slots,  generating  a "PARTOF 
hierarchy".  The  classes  themselves  are  organized  in  an  "ISA  hierarchy", 
which  expresses  generalization  relationships  between  classes  and 
subclasses . 

In  addition  to  these  two  hierarchies,  the  system  of  Levesque  and 
Mylopoulos  also  has  an  "instance  hierarchy".  Every  class  is  itself  an 
instance  of  the  class,  "CLASS,"  which  is  termed  a "metaclass".  Adding 
this  distinction  allows  a precise  account  of  inheritance,  and  of 
relations  often  mistaken  in  more  uniform  schemes  — including  the 
descriptions  of  the  programs  themselves.  Levesque  and  Mylopoulos  also 
provide  nice  accounts  of  the  distinctions  between  structural  and 
aasertional  properties  and  between  property  attributes  and  property 
values,  and  account  with  their  procedures  for  the  interdependencies 
between  pieces  of  a structure.  As  such,  their  account  would  provide  a 
good  set  of  tools  for  exploring  the  semantics  of  the  representation  to 
be  presented  in  Section  3*  The  only  major  shortcoming  is  the  lack  of  an 
explicit  representation  of  the  relationships  between  the  parts  of  a 
class,  since  their  dependencies  are  only  implicitly  accounted  for  in  the 
four  programs  associated  with  a class  definition. 


2.  ”Sia&  Ceiling  Another  FlQOr" 

Given  this  rich  and  interesting  history,  what,  can  we  conclude,  is  a 
"semantic  net"?  About  the  only  thing  in  common  among  all  of  the  above- 
discussed  formalisms  is  their  connectivity  — the  fact  that  they  all 
claim  to  be  made  of  "links"  and  "nodes".  But  these  two  kinds  of  entity 
are  really  Just  descriptive  of  implementations  — they  have  nothing  to 


1 

1 

H 


J 

J 

] 

J 

I 

) 

I 

J 


-28- 


"One  Man's  Ceiling  Is  Another  Man's  Floor"  Bolt  Beranek  and  Nevnnan  Inc. 


say  about  the  epistemological  import  of  these  networks.  While  Gary  | 

Hendrix  states,  "Broadly  speaking,  any  representation  Interlinking  nodes  i 

with  arcs  could  be  called  a semantic  network,..."  [Hendrix  1977,  p.  I 

984],  1 believe  that  there  is  something  amiss  in  this  Interpretation. 

Hendrix's  definition  is  indistinguishable  from  that  of  a graph  — and 
there  is  nothing  inherently  "semantic"  about  a graph. 

The  "semanticness"  of  semantic  nets  lies  in  their  being  used  in 
attempts  to  represent  the  semantics  of  English  words.  Besides  nodes  and 
links,  the  common  thread  that  has  held  together  the  many  efforts 
described  in  Section  1 is  the  fact  that  most  of  the  networks  were  to  be 
used  in  understanding  natural  language.  Semantic  nets  have  become  a 
popular  meaning  representation  for  use  in  natural  language  understanding 
systems . 

Despite  the  fact  that  virtually  all  semantic  networks  have  been  used 
to  represent  the  "concepts"  corresponding  to  words  and  sentences,  there 
has  been  very  little  agreement  on  how  to  factor  such  knowledge.  The 
most  important  disagreement  — as  evidenced  by  the  fact  that  we  find  no 
two  sets  of  links  the  same  in  the  literature  — has  to  do  with  the 
structural  decomposition  of  a concept.  While  only  the  most  recent  work 
[Brachman  1978a, b,  Levesque  and  Mylopoulos  1978,  Saith  1978]  has  dealt 
with  concept-structuring  per  ae . every  network  implicitly  embodies  a 
theory  of  the  primitive  elements  that  make  up  a concept.  Structural 
links  holding  together  the  arguments  of  a logical  predicate,  "deep 
semantic  cases",  and  even  conceptual  relations  that  are  supposed  to 
exist  between  objects  in  the  world  have  all  been  proposed  as  semantic 
network  links. 


Consider  the  following  statements: 

- The  distinction  between  these  alternatives 


significant  one  since  logical  forms  are 


es  appears  to 
clearly  formal 


to  be  a 


tanings  oi  suriac^ 
the  latter  are  labeled  graphs  which  somehow  represent  these  same 
meanings.  This  distinction  quickly  evaporates,  however,  the  moment 
one  observes  that  a network  is  basically  a particular  choice  of 
representation  (at  the  implementation  level;  for  some  ( ponoantual 
level)  logical  form.  [Nasn^Weboerand  Reiter  1977,  p.  I2l J 


level)  logical  form.  [Nash-Webber  and  Reiter  1977,  p.  121 J 
- If  someone  argues  for  the  superiority  of  semantic  networks  over 


ly  a particular  cnoioe  or 
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logic,  he  must  be  referring  to  some  other  property  of  the  former 
than  their  meaning...  [Pat  Hayes  1977 • p.  561] 

- A semantic  network  purports  to  represent  concepts  expressed  by 
natural-language  words  and  phrases  as  nodes  connected  to  other  such 
concepts  by  a particular  set  of  arcs  called  semantic  relations. 
Primitive  concepts  in  this  system  of  semantic  networks  are 
word-sense  meanings.  Primitive  semantic  relations  are  those  that 
the  verb  of  a sentence  has  with  its  subject,  object,  and 
prepositional  phrase  arguments  in  addition  to  those  that  underlie 
common  lexical,  classiflcational  and  modificational  relations. 
[Simmons  1973,  p.  63] 

How  are  we  to  rationalize  such  disparate  views  of  what  has  always  seemed 
to  be  a single  formalism? 


2.1.  Will  the  real  semantic  network  please  stand  up? 

The  key  issue  here  is  the  isolation  of  the  primitives  for  semantic 
network  languages.  The  primitives  of  a network  language  are  those 
things  which  the  Interpreter  is  programmed  in  advance  to  understand,  and 
which  are  not  usually  represented  in  the  network  language  itself.  While 
there  is,  of  course,  no  one  set  of  primitives  that  is  the  set,  for  any 
single  language  there  should  be  one  fixed  group  of  primitive  elements. 
Only  with  a fixed  set  of  primitives  can  a fixed  Interpreter  be 
constructed! 11 } . It  would  be  difficult  to  Justify  an  Interpreter  in 
which  the  set  of  primitives  changed  meaning,  or  for  which  it  was 
expected  that  new  primitives  were  to  be  added  in  the  course  of 
interpretation . 

The  view  that  1 will  take  here  is  that  the  history  of  semantic  nets 
and  their  utility  as  a representational  device  can  best  be  understood  by 
carefully  examining  the  nature  of  the  primitives  that  have  been 
proposed.  Since  the  semantics  of  any  given  language  is  dependent  on  the 
interpretation  of  the  primitive  elements  and  a set  of  rules  for 
combining  them  into  non-primitive  elements,  the  "well-definedness”  of  a 


{11}  It  is  probably  also  desirable  to  have  this  set  as  small  as 
TOssible.  However,  at  the  current  stage,  we  will  settle  for  any  set 
that  is  adequate.  One  of  the  purposes  of  this  paper  (see  Section  3)  is 
to  begin  to  circumscribe  what  would  be  an  adequate  set  of  primitives, 
and  therefore,  an  adequate  interpreter. 
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network  language  rests  heavily  on  the  set  of  node  and  link  types  that  It 
provides.  While  it  Is  difficult  to  make  simple,  clear-cut  comparisons 
of  primitives  from  one  language  to  the  next,  It  Is  possible  to  distill  a 
small  number  of  distinctive  types  of  nodes  and  links  from  the  formalisms 
discussed  In  Section  1.  Each  of  these  types  can  be  considered  to  form  a 
consistent  conceptual  "level";  I will  therefore  propose  a set  of 
levels,  or  viewpoints,  with  which  to  understand  the  range  of  semantic 
network  primitives  that  have  been  used  in  the  past.  Each  of  the  levels 
will  have  a set  of  link  types  whose  Import  is  clearly  distinct  from 
those  of  other  levels. 

Any  network  notation  could  be  analyzed  In  terms  of  any  of  the 
levels,  since  they  do  not  really  have  any  absolute.  Independent 
"existence".  For  example,  a particular  concept  might  be  structured  with 
semantic  cases.  These  cases  can  be  understood  as  sets  of  logical 
predicates,  which  in  turn  are  Implemented  with  some  set  of  atoms  and 
pointers.  However,  each  network  scheme  does  propose  an  explicit  set  of 
primitives  as  part  of  the  language,  2md  this  is  the  set  that  is  actually 
supported  by  the  language's  interpreter.  The  particular  sets  of 
primitives  that  are  proposed  in  particular  languages  are  the  ones  of 
interest  to  us  here.  Understanding  past  problems  with  semantic  nets  and 
what  one  is  getting  when  s/he  uses  a particular  semantic  net  scheme  are 
both  facilitated  by  looking  closely  at  these  explicit  primitive 
sets{12}.  As  we  shall  see,  one  set  of  difficulties  has  arisen  because 
most  network  notations  freely  intermix  primitives  of  different  types. 

The  diverse  opinions  on  the  primitives  of  semantic  networks 
expressed  both  explicitly  in  the  literature  and  implicitly  in  the  style 
of  existing  networks  indicate  that  there  are  at  least  four  main  levels 
of  primitive  to  be  considered.  The  first  view,  expressed  by  the  quote 


{12}  The  assignment  of  a notation  to  a particular  level  should  not  be 
taken  as  a value  Judgment  (very  few  formalisms  can,  in  fact,  be  assigned 
to  a single  level).  Different  level  notations  are  useful  for  different 
tasks.  Here  it  is  asked  only  that  one  become  aware  of  the  level  at 
which  s/he  stops  decomposing  concepts,  and  understands  the  meaning  of 
her/his  primitives  as  potentially  decomposed  into  "lower"  level  ones. 
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from  Nash-Webber  and  Reiter  above,  considers  a semantic  network  to  be  an 
implementational  mechanism  for  a higher-level  logical  language.  This 
view  we  might  call  the  implementational  form  of  semantic  nets.  In 
implementation  level  networks,  links  are  merely  pointers,  and  nodes  are 
simply  destinations  for  links.  These  primitives  make  no  important 
substantive  claims  about  the  structure  of  knowledge,  since  this  level 
takes  a network  to  be  only  a data  structure  out  of  which  to  build 
logical  forms.  While  a useful  data  organizing  technique,  this  kind  of 
network  gives  us  no  more  hint  about  how  to  represent  (factor)  knowledge 
than  do  list  structures. 

A second  view  sees  a semantic  network  as  a set  of  logical  primitives 
with  a structured  index  over  those  primitives.  In  this  type  of  logical 
level  net,  nodes  represent  predicates  and  propositions.  Links  represent 
logical  relationships,  like  AND,  SUBSET,  and  THERE-EXISTS.  The  above 
quote  from  (Pat)  Hayes  expresses  a viewpoint  which  is  essentially  the 
same  as  those  implicitly  expressed  in  networks  by  Schubert  and  Hendrix, 
to  some  extent  Shapiro,  and  to  a lesser  extent  Woods.  In  this  point  of 
view,  logical  adequacy,  including  quantiflcatlonal  apparatus,  is  taken 
to  be  the  responsibility  of  semantic  network  representations  of 
knowledge.  The  aforementioned  efforts  express  a tacit  dependence  on 
predicate  calculus  for  knowledge  factoring  and  espouse  network  schemes 
as  useful  organizing  principles  over  normally  non-indexed  predicate 
calculus  statements.  In  doing  so,  they  make  at  least  some  claim  about 
how  knowledge  can  be  meaningfully  factored.  It  is  interesting  to  note 
that  almost  all  of  the  "foundational"  work  on  semantic  networks  has  been 
done  at  this  logical  level  of  interpretation. 

The  most  prevalent  view  of  networks  is  reflected  in  Simmons'  above 
statement  and  almost  all  of  the  work  discussed  in  Section  1.  This  is,  in 
some  sense,  the  "real"  semantic  net  — a network  structure  whose 
primitives  are  word-senses  and  case  relations.  As  Simmons  notes,  in 
these  conceptual  level  nets,  links  represent  semantic  or  conceptual 
relationships.  Networks  at  this  level  can  be  characterized  as  having 
small  sets  of  language- Independent  conceptual  elements  (namely, 
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primitive  object-  and  action-types)  and  conceptually  primitive 
relationships  (l.e.  "deep  cases")  out  of  which  all  expressible  concepts 
can  be  constructed.  The  strongest  view  at  this  level  is  that  of  Schank 
and  followers,  which  picks  a small  set  of  act  types  (e.g.  GRASP, 

INGEST,  PTRANS)  and  cases  (e.g.  INSTRUMENT,  RECIPIENT)  and  claims  that 
this  set  is  adequate  to  represent  the  knowledge  expressed  in  any  natural 
language{ 13} . Weaker  views  are  embodied  in  the  Norman  and  Simmons  nets, 
where  it  is  difficult  to  tell  if  there  are  any  truly  primitive  knowledge 
pieces.  In  these  nets,  the  belief  in  cases,  and  the  particular  sets 
settled  upon,  seem  to  be  the  unchanging  elemental  units. 

Finally,  going  one  step  higher,  we  might  consider  networks  whose 
primitive  elements  are  language-specific.  The  only  formalism  that  I 
know  of  at  the  current  time  that  embodies  this  view  is  OWL,  whose 
elements  are  expressions  based  on  Engllsh{l4}.  In  such  a formalism,  one 
would  presumably  "...take  seriously  the  Whorflan  hypothesis  that  a 
person's  language  plays  a key  role  in  determining  his  model  of  the  world 
and  thus  in  structuring  his  thought"  [Martin  1977,  p.  985].  In  OWL, 
there  is  a basic  concept-structuring  scheme  (see  [Hawklnson  1975])  which 
is  used  to  build  expressions,  and  strictly  speaking,  the  principles  of 
"specialization",  "attachment",  and  "reference"  are  the  primitives  of 
the  language.  However,  these  primitives  are  neutral  enough  to  be 
considered  implementatlonal,  and  thus  the  knowledge  itself  can  be 
considered  to  form  the  structure  of  the  data  base.  This  seems 
operationally  reasonable  when  OWL  is  looked  at  in  detail  — the  two 
expressions,  (HYDRANT  FIRE)  and  (MAN  FIRE),  while  both  specialized  by 
FIRE,  can  have  the  specializations  "mean"  different  things  based  on  the 
rest  of  the  network  structure.  This  linguistic  level  represents  perhaps 


{13}  In  general,  a characteristic  of  this  level  is  that  it  should  be 
language-independent . 


i 


f 


{14}  "We  have  taken  English  as  the  basis  for  our  knowledge 
representation  formalism"  [Szolovits.  Hawklnson  and  Martin  1977,  p.  2]. 
Not  surprisingly,  the  view  of  the  OWL  group  is  that  their  "Linguistic 
Memory  System"  is  a semantic  network:  "The  most  novel  aspects  of  OWL  are 
the  structure  of  the  semantic  net  (Hawklnson,  1975)  ..."  [Martin  1977, 
p.  985] 
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the  most  radical  view  of  semantic  nets,  In  that  the  "primitives"  are 
language-dependent,  and  are  expected  to  change  In  meaning  as  the  network 
grows.  Links  In  linguistic  level  networks  stand  for  arbitrary 
relationships  that  exist  in  the  world  being  represented. 

It  should  be  obvious  that  each  of  the  above  viewpoints  Implies  a set 
of  primitive  relationships  substantially  different  from  the  others. 
Relationships  between  predicates  and  propositions  (e.g.  AND,  ARGUMENTI, 
PRED)  are  distinctly  different  than  those  between  verbs  and  associated 
"cases"  (e.g.  AGENT,  INSTRUMENT,  RECIPIENT).  Both  of  these  are  not  the 
same  as  arbitrary  relationships  between  things  In  the  world  (l.e. 
relations  between  the  entities  that  the  concepts  are  supposed  to  denote, 
e.g.  COLOR,  HIT).  And  further,  none  of  these  Is  the  same  as  the 
relations  between  the  parts  of  an  intensional  description,  to  which  we 
now  turn. 

2.2.  The  missing  level 

While  this  characterization  of  the  levels  of  semantic  network 
representations  covers  virtually  all  of  the  work  that  has  been  done, 
there  appears  to  be  at  least  one  level  missing  from  the  analysis.  That 
this  is  the  case  is  suggested  by  some  of  the  more  recent  phenomena 
appearing  in  network  languages,  including  "partitions",  "delineations" 
[Hendrix  1975a, b,  1976]  and  "binders"  [Philip  Hayes  1977a, b){15l • These 
K features  suggest  the  possibility  of  organizations  of  conceptual 

knowledge  Into  units  more  structured  than  simple  nodes  and  links  or 
predicates  and  propositions,  and  the  possibility  of  processing  over 
larger  units  than  single  network  links.  The  predominant  use  of  concepts 
as  intensional  descriptions  of  objects  in  a world  also  hints  that  there 
is  a class  of  relationship  that  is  not  accounted  for  by  the  four  levels 
already  discussed.  This  kind  of  relationship  relates  the  parts  of  an 

{15}  Non-network  languages,  like  KRL  [Bobrow  and  Winograd  1977]f  have 
similar  types  of  mechanisms  playing  a more  and  more  prominent  part. 
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Intension  [Carnap  19^7]  to  the  intension  as  a whole,  and  one  intension 
to  another.  Intensional  descriptions  can  be  related  directly  by  virtue 
of  their  internal  structures,  or  indirectly  by  virtue  of  their 
corresponding  extensions! 16} . In  addition,  even  the  single  most  common 
trait  of  semantic  networks  — "inheritance"  — suggests  a level  of 
knowledge  structure  between  the  logical  and  conceptual  ones  described 
above.  Inheritance  of  properties  is  not  a logical  primitive;  on  the 
other  hand,  it  is  a mechanism  assumed  by  almost  all  conceptual  level 
nets,  but  not  accounted  for  as  a "semantic"  (deep  case)  relation. 

There  must  be  some  intermediate  level  at  trtiich  a precise  formal 
account  of  such  notions  can  be  constructed.  The  very  attempt  to  give 
conceptual  units  more  structure  than  that  of  uniform  configurations  of 
links  hints  that  at  least  some  network  designers  have  been  thinking 
about  "concepts"  as  formal  objects,  with  predetermined  internal 
organization  that  is  more  sophisticated  than  sets  of  "cases".  The 
formal  structure  of  conceptual  units  and  their  interrelationships  as 
conceptual  units  (Independent  of  any  knowledge  expressed  therein)  forms 
what  could  be  called  an  "epistemology".  I will  propose,  then,  an 
intermediate  level  of  network  primitive  that  embodies  this  formal 
structuring.  This  will  be  called  the  "epistemological"  level,  and  it 
lies  between  the  logical  and  semantic  levels. 

The  epistemological  level  of  "semantic"  network  permits  the  formal 
definition  of  knowledge-structuring  primitives,  rather  than  particular 
knowledge  primitives  (as  in  the  Schank  networks).  Note  that  networks  at 
the  next  higher  level  (conceptual)  take  as  their  primitives  pieces  of 
semantic  knowledge  and  "cases",  but  with  no  explicit  accounting  for 
their  internal  structure.  While  there  is  no  universal  agreement  on  what 

cases  there  are,  everyone  agrees  that  there  are  probably  at  least  some 

•• 

cases,  and  they  all  seem  to  have  a feel  for  what  a case  is.  The  basis 
for  this  agreement  on  the  concept  of  case  (or  "slot")  and  the 


{16}  KRL  has  also  focussed  intensively  on  the  issue  of  description  — 
most  notably,  what  constitutes  a description,  and  how  descriptions  in 
the  above  sense  are  inherently  partial. 
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inheritance  of  cases  in  a network  is  provided  by  the  epistemological 
level,  which  explains  the  meaning  of  cases  in  general  and  provides  a 
defining  mechanism  for  particulzu'  ones. 

In  Section  3 I will  touch  on  some  of  the  other  operations  that  nets 
built  out  of  explicit  epistemological  primitives  should  account  for.  In 
that  section,  I will  also  introduce  a formalism  expressly  based  on  those 
notions.  Briefly,  relations  at  the  epistemological  level  Include  those 
used  to  structure  intensional  descriptions,  and  those  used  to 
interrelate  them.  The  former  involves  piecing  together  aspects  of  a 
description,  including  descriptions  of  the  conceptual  subpieces  of  an 
object  and  how  they  Intertwine.  One  such  type  of  conceptual  subpiece  is 
a "case",  the  meaning  of  which  is  taken  to  be  something  built  out  of 
epistemological  primitives.  The  latter  type  of  relation  specifies 
inheritance  of  subdescriptions  between  descriptions. 

Table  1 summarizes  our  discussion  of  the  five  levels.  The  examples 


Level 


4' 


Jr 


Implementational 

Logical 

Epistemological 

Conceptual 

Linguistic 


Atoms,  pointers  Data  structures 

Propositions,  [Schubert  1976], 

predicates,  logical  .Cercone  1975], 

operators  [Hendrix  l975a,b] 

Concept  types,  conceptual  [Brachman  1978a,b] 
subpieces,  inheritance 
and  structuring 
relations 

Semantic  or  conceptual  [Schank  1972,  etc.], 

relations  ("cases"),  .Simmons  1973,  etc.], 

primitive  objects  [Norman  jgt  .al-  1975] 

and  actions 

Arbitrary  concepts,  [Szolovits  1977] 

words,  expressions 


Table  1.  Levels  of  "semantic"  networks 


listed  with  the  levels  are  suggestive  of  the  philosophy  of  those  levels; 
none  is  really  a "pure"  example  of  a single  primitive  type.  Although  a 
desirable  goal  (as  we  shall  see  below),  it  is  not  clear  that  a pure 
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network  at  any  level  Is  attainable.  Our  task  here,  then,  Is  to 
understand  as  well  as  possible  each  type  of  primitive  so  that  the 
semantics  of  any  formalism  can  be  clearly  and  completely  specified,  even 
If  It  mixes  elements  of  more  than  one  level. 


2.3.  Neutrality,  adequacy,  and  semantics 

Despite  the  fact  that  we  have  Isolated  five  distinct  types  of 
"semantic"  net,  there  are  some  universal  notions  that  can  be  applied 
equally  well  to  each  type  of  network.  These  are  neutrality,  adequacy, 
amd  semantics . Each  of  these  can  be  used  as  a criterion  for  Judging  the 
utility  and  formality  of  a given  network  language.  It  Is  desirable  that 
a formalism  be  as  pure  as  possible,  adequate  to  handle  Its  appointed 
representation  task,  and  have  a clean,  explicitly  specified  semantics. 

A network  Implemented  at  some  level  should  be  neutral  toward  the 
level  above  It.  For  example,  logical  nets  are  "epistemologically 
neutral" , In  that  they  do  not  force  any  choice  of  epistemological 
primitives  on  the  langu2ige  user.  Making  "concepts"  In  logical  nets, 
then.  Is  a mixing  of  levels.  Conceptual  level  nets  must  support  many 
different  linguistic  systems,  and  should  be  linguistically  neutral  (as 
Schank  puts  It,  "The  principal  problem  that  we  shall  address  here  Is  the 
representation  of  meaning  In  an  unambiguous  language-free  manner" 

[1973b,  p.  187]).  By  the  same  token,  of  course,  epistemological 
formiallsms  must  be  neutral  In  regard  to  particular  semantics.  It  Is  the 
Job  of  the  epistemological  formalism  to  provide  case-defining  facilities 
— not  particular  cases. 

A formalism  at  any  of  the  four  lower  levels  that  Is  neutral  toward 
the  one  above  Is  a useful  tool  for  designers  of  those  at  higher  levels. 
Epistemological  neutrality,  for  example,  ensures  flexibility  In  the 
design  and  definition  of  particular  cases  or  non-standard  types  of 
Inheritance.  It  should  be  clear,  then,  that  one  of  the  main  problems 
with  many  of  the  older  formalisms  was  their  lack  of  a clear  notion  of 
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what  level  they  were  designed  for.  Almost  universally,  semantic 
networks  have  mixed  primitives  from  more  than  one  level  (for  example, 
particular  cases  were  links  in  the  same  systems  in  which  set  membership 
was  a link).  In  terms  of  neutrality,  these  formalisms  were  all  less 
flexible  than  they  could  have  been  in  serving  knowledge  base  designers 
who  were  building  structures  on  top  of  them.  Decisions  were  forced  at 
more  than  one  level  at  a time;  the  simultaneous  freedom  on  some  issues 
and  lack  of  flexibility  on  others  (at  the  same  level)  has  been  a 
constant  source  of  confusion  for  network  language  users  throughout  the 
history  of  semantic  nets. 

Any  level  network  can  also  be  Judged  on  its  adequacy  for  supporting 
the  level  above  it.  If  a semantic  net  can  somehow  support  all  possible 
linguistic  systems  of  knowledge,  then  it  has  achieved  "conceptual 
(semantic)  adequacy".  While  the  particular  features  of  conceptual 
adequacy  are  open  to  debate,  the  notion  of  adequacy  for  the  logical 
level  is  well  understood  (see  [Schubert  1976],  for  example).  At  the 
current  time,  it  is  less  clear  what  it  would  take  for  a network 
representation  language  to  be  epistemologically  adequate.  This  is  a 
subject  (as,  for  example,  treated  in  [Brachman  1978b])  that  is  ripe  for 
study,  and  to  which  1 would  like  to  draw  the  reader's  attention. 
Treatments  of  criteria  for  epistemological  adequacy  have  heretofore  been 
missing  from  network  studies.  Yet  it  seems  that  the  understanding  of 
knowledge  representation  languages  in  general  will  depend  Intimately  on 
an  understanding  of  vrtiat  the  elements  of  epistemological  adequacy  are, 
and  how  well  given  languages  handle  them.  We  will  look  at  some  aspects 
of  this  in  the  next  section. 

Thinking  in  terms  of  adequacy  gives  us  another  reason  why  previous 
semantic  networks  have  been  difficult  to  assess.  Given  networks  that 
mixed  levels  of  primitives,  it  was  impossible  to  tell  what  exactly  the 
networks  were  adequate  for.  The  recent  push  toward  completely  logical 
networks  was  in  part  motivated  by  the  desire  to  achieve  for  the  first 
time  a network  that  was  demonstrably  adequate  in  a well-understood  way. 
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Finally,  each  type  of  network  language  must  be  held  accountable  for 
its  semantics  — what,  formally,  do  each  of  its  elements  mean,  and  what 
are  the  legal  operations  on  them? (17)  In  this  respect,  the  attempts  to 
define  logically  adequate  nets  (Schubert,  Cercone,  Hendrix,  etc.)  have  a 
clear  advantage  over  all  of  the  others:  once  a mapping  to  predicate 
calculus  is  established,  a formal  semantics  (l.e.  Tarskian 
truth-theoretic)  is  available,  essentially  for  free.  This  requirement, 
on  the  other  hand,  makes  a formal  semantics  for  linguistic  level  nets 
almost  impossible  to  achieve,  since  it  would  require  a formal  semantics 
to  be  defined  for  the  particular  natural  language  involved.  For 
conceptual  level  nets,  only  Schank  and  Rieger  [197**]  have  provided  a 
well-defined  semantics,  in  that  they  have,  in  advance,  specified  sets  of 
"inferences"  for  each  of  their  predetermined  primitive  acts.  Thus  an 
act  is  defined  in  terms  of  its  inferences,  and  there  are  rules  for 
combining  inferences  into  interpretations  of  larger,  non-primitive 
structures,  based  only  on  the  primitives  out  of  which  they  are  built. 
Other  conceptual  level  nets  do  not  have  fixed  primitives,  thereby  making 
it  difficult  to  provide  an  acceptable  semantics. 

Formal  semantics  for  epistemological  level  languages  are  currently 
under  study;  studies  of  such  semantics  must  however  be  done  in  parallel 
with  those  attacking  epistemological  adequacy,  since  the  nature  of  the 
epistemological  primitives  is  not  yet  understood,  which  therefore  makes 
it  hard  to  define  a semantics.  Three  particular  studies  are  of  note 
here:  1)  in  [Brachman  1978b],  I attempt  to  ferret  out  the  meaning  of  a 
network  language  by  making  each  basic  relationship  available  as  a 


{17}  The  reader  should  be  warned  here  that  I am  using  the  term 
"semantics"  in  its  currently  popular  A1  sense,  wherein  the  meaning  of  a 
primitive  is  provided  by  the  programs  that  operate  on  it.  While  the 
notion  of  links  being  meaningrul  by  virtue  of  the  programs  that  use  them 
seems  intuitively  clear  and  reasonably  precise,  there  is  a lot  more  to 
be  said  on  the  issue.  Semantics  deals  with  the  relationship  between  a 
symbol  and  what  it  denotes.  Therefore  not  only  should  we  take  careful 
account  of  what  here  is  a symbol  (e.g.  some  marks  on  a piece  of  paper, 
an  arrow  with  a word  next  to  it,  a set  of  bits  in  a computer,  etc.),  but 
we  must  also  be  precise  about  what  these  symbols  denote  (l.e.  what  are 
"epistemological  relations",  anyway?).  Brian  Smith  treats  these 

froblems  in  Insightful  depth  in  his  Master's  thesis  [1978].  See  also 
Fodor  1978]  for  a recent  critique  of  "procedural  semantics". 
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"link",  and  then  explaining  in  detail  the  epistemological  significance 
of  each  link;  2)  the  work  of  Levesque  and  Mylopoulos  at  Toronto  [1976, 
Levesque  1977]  investigates  a procedural  semantics  in  a similar  manner 
— except  that  the  nature  of  the  procedures  themselves  is  being  dealt 
with  in  a general,  network-expressible  way;  and  3)  Smith  [1978]  is 
working  on  a comprehensive  paradigm  for  knowledge  representation 
languages  in  general,  which  includes  a non-circular  explanation  for  the 
interpreter  of  the  procedures{ 18} , as  well  as  accounts  of 
"meta-descrlptlon",  structured  inheritance,  believing  as  an  active 
process  that  denotes,  etc. 


3.  An  Epistemologically  Explicit  Representation 

In  this  final  section,  1 hope  to  Illustrate  what  a network  formalism 
at  the  epistemological  level  of  knowledge  representation  should  be 
concerned  with.  Such  a formalism  should  have  a clean,  well-understood 
semantics,  should  not  depend  in  any  way  upon  the  domain  to  which  it  is 
applied,  and  should  adequately  handle  the  significant  epistemological 
relationships  of  concept  structuring,  attribute/value  Inheritance, 
multiple  description,  etc. 

In  order  to  make  the  ideas  more  concrete,  I will  discuss 
epistemological  primitives  in  terms  of  a particular  type  of  formalism 
called  "Structured  Inheritance  Networks"  (SI -Nets)  [Brachman  1978a, b]. 
Si-Nets  were  developed  expressly  to  address  the  above  cited 
epistemological  issues,  and  to  provide  a useful  exaplanatory  tool  for 
semantic  level  languages.  SI -Nets  constitute  a class  of  network 
languages  whose  links  represent  epistemologically  primitive  relations. 
For  the  purposes  of  this  discussion,  we  will  use  a paradigmatic  example 


{18}  The  account  of  the  procedures  of  Levesque  and  Mylopoulos  is,  of 
necessity,  circular,  since  the  procedures  are  being  defined  in  the  same 
network  for  which  they  attempt  to  provide  the  semantics. 
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of  this  class,  called  "KLONE".  While  KLONE  will  be  discussed  only 
briefly  here,  details  are  available  in  [Brachman  1978a, b]. 

The  basic  elements  of  KLONE  (as  they  are  in  most  semantic  net 
schemes)  are  Concepts.  Concepts  are  formal  objects  used  to  represent 
objects,  attributes,  and  relationships  of  the  domain  being  modelled.  A 
Concept  is  thought  of  as  representing  an  Intenslonal  object,  and  no 
Concepts  are  used  to  represent  directly  extensional  (world)  objects. 
There  are  two  main  Concept  types  — Generic  and  Individual.  Generic 
Concepts  represent  classes  of  individuals  by  describing  the 
characteristics  of  a prototypical  member  of  the  class.  Individual 
Concepts  represent  individual  objects,  relationships,  etc.  by 
individuating  more  general  Concepts.  Individuation  is  a relationship 
between  Concepts.  The  term  "instance"  has  been  used  in  many  network 
models  to  refer  to  an  individuating  description,  as  well  as  to  the  thing 
in  the  world  that  the  individual  description  describes.  Here,  however, 
we  will  use  "instantiation"  only  as  a relationship  between  a thing  in 
the  world  and  a Generic  Concept,  and  not  as  a relationship  between 
Concepts.  Thus,  the  Arc  de  Trlomphe  (l.e.  the  one  in  Paris)  is  an 
"instance"  of  the  Concept,  ARCH;  the  Individual  Concept  (call  it 
"ARC-DE-TRIOMPHE")  that  denotes  the  Arc  de  Triomphe  "individuates"  the 
Concept,  ARCH.  The  relationship  between  ARC-DE-TRIOMPHE  and  the  real 
Arc  is  "denotation".  See  Fig.  15  for  a schematic  picture  of  this 
three-way  relationship. 


3.1.  Internal  Concept  structure 

The  key  observation  of  Si-Nets  is  that  objects  in  the  world  have 
complex  relational  structure  — they  cannot,  in  general,  be  usefully 
taken  as  atomic  entities  or  mere  lists  of  properties  (see  [Brachman 
1976,  1978b]  for  detailed  Justification).  A Concept  must  therefore 
account  for  this  Internal  structure  as  well  as  for  the  object  as  a 


wholistlc  entity.  The  KLONE  formal  entities  that  support  this  view  of 
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Figure  15.  A sketch  of  the  Individuates/Instantiates  dichotomy. 

structured  objects  are  "Role/Flller  Descriptions"  (Roles)  and 
"Structural  Descriptions"  (SD's).  Roles  represent  the  conceptual 
subpieces  of  an  entity,  vrtille  SD’s  account  for  the  structuring 
relationships  between  them. 

The  Roles  represent  the  various  kinds  of  attributes,  parts,  etc. 
that  things  in  the  world  are  considered  to  "have".  These  Include,  for 
example,  such  things  as  parts  (e.g.  fingers  of  a hand).  Inherent 
attributes  of  objects  and  substances  (e.g.  color),  arguments  of 
functions  (e.g.  multiplier  and  multiplicand  of  a multiplication),  and 
"cases"  of  verbs  in  sentences  (e.g.  "agent"){19} • Any  generalized 
attribute  of  this  sort  has  two  Important  pieces:  1)  the  particular 
entity  that  becomes  the  value  for  the  attribute  in  an  instance  of  the 
Concept,  and  2)  the  functional  role  which  that  entity  fills  In  the 
conceptual  complex.  A Role  Is  a formal  entity  that  captures  both  of 


{19}  1 have  In  the  past  ([Brachman  1978a.b])  referred  to  the 
generalization  of  this  kind  of  conceptual  subpart  as  a "dattr".  Here  1 
will  use  the  term,  "generalized  attribute". 
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these  aspects  in  a structured  way,  by  packaging  up  information  about 
both  the  role  filler  and  the  functional  role  Itself. 

In  KLONE  the  substructure  of  a Role  indicates  the  following:  the 
type  of  entity  that  can  fill  the  functional  role,  how  many  fillers  of 
that  role  are  to  be  expected,  whether  It  Is  Important  in  some  way  to 
have  the  role  filled  In  an  Instance,  and  the  name  of  the  functional  role 
Itself.  Notice,  then,  that  the  formal  entity,  "Role",  Is  somewhat  more 
than  a description  of  either  the  potential  filler  or  the  functional  role 
alone.  It  is  a very  special  type  of  epistemological  entity  that  ties 
together  the  functional  role,  the  context  In  which  that  role  Is  played, 
and  the  (set  of)  flller(s)  of  the  role.  Figure  16  schematically 


Figure  16.  Role  structure. 

Illustrates  the  Internal  structure  of  a Role  and  Its  place  In  a Concept 
(Roles  will  henceforth  be  pictured  as  small  squares,  while  Concepts  will 
be  depicted  as  ovals). 

As  just  mentioned,  »rtiile  the  "internal"  Role  structure  indicates 
Information  about  the  particular  fillers  In  themselves,  the  Role  Itself 
Is  the  meeting  place  for  information  about  how  those  fillers  fit  into 

-43- 


BBN  Report  No.  3807 


Section  3*1 


the  entire  conceptual  complex.  It  Is  the  Concept's  set  of  Structural 
Descriptions  (SD's)  which  is  the  source  of  information  about  how  role 
fillers  interact  with  each  other.  Each  SD  is  a set  of  relationships 
between  two  or  more  of  the  Roles.  Just  as  a Role  indicates  that  for  any 
instance  of  the  Concept  there  will  be  the  appropriate  number  of  fillers 
(with  the  corresponding  characteristics)  for  the  given  functional  role, 
an  SD  Indicates  that  any  instance  of  the  Concept  will  exhibit  the 
relationships  specified  in  that  SD.  So,  for  example,  the  Concept  for  a 
simple  arch,  which  has  three  bricks  as  its  parts,  might  be  factored  as 
in  Fig.  17  (SD's  are  indicated  by  diamonds). 


Figure  17.  A simple  KLONE  Concept. 

In  this  figure.  Role  R1  expresses  the  fact  that  this  kind  of  arch 
has  one  "LINTEL",  which  must  be  a WEDGE-BRICK.  The  RoleD  link  expresses 
the  relationship  between  the  Concept,  ARCH,  and  one  of  its  Role 
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descriptions;  the  V/R  (Value  Restriction)  link  points  to  the  type  1 

predicate  that  must  be  true  of  the  eventual  role  filler;  the  Number  link 

Indicates  the  restriction  on  the  number  of  fillers  of  the  role;  the 

Modality  link  Indicates  the  Importance  of  the  attribute  to  the  Concept; 

and  finally,  the  RoleName  link  names  the  relationship  (conceptual,  not 

epistemological)  between  the  filler  and  the  whole.  R2  similarly 

Indicates  that  any  example  of  this  type  of  object  has  two  "UPRIGHTS", 

which  are  BRICKs.  R3  defines  the  generalized  attribute  of 

"VERTICAL-CLEARANCE".  The  Modality.  INHERENT,  means  that,  while  every 

arch  has  one  of  these,  knowing  Its  value  Is  not  critical  to  the 

recognition  of  some  object  as  an  ARCH{20}.  In  addition,  DERIVABLE  means  | 

that  the  value  can  be  computed  from  the  the  values  of  the  other  Roles,  | 

once  they  are  found.  As  for  the  SD's,  SI  Is  a set  of  relationships  that  I 

expresses  how  every  UPRIGHT  supports  the  LINTEL,  S2  specifies  that  no  | 

two  UPRIGHTS  touch  each  other,  and  S3  embodies  the  definition  of  the  | 

VERTICAL-CLEARANCE  In  terms  of  the  LINTEL  and  an  Individual  Concept,  | 

"GROUND".  We  now  turn  briefly  to  the  internal  structure  of  these  | 

relational  parts  of  the  Concept.  | 

Let  us  say  that  we  want  to  define  the  VERTICAL-CLEARANCE  of  an  ARCH  j 

to  be  the  distance  between  Its  lintel  and  the  ground.  There  will  thus 
be  some  Concept  related  to  DISTANCE  in  one  of  the  SD's  of  ARCH.  To 
determine  the  exact  nature  of  this  Concept,  let  us  look  at  the  way  that 
we  have  expressed  the  relationship  in  English:  first,  the  definite 
determiner  for  "ground"  indicates  that  we  mean  a unique  lndlvidual{21} . j 

To  reflect  this,  our  network  would  have  an  Individual  Concept,  GROUND, 
which  corresponded  to  that  "constant".  Further,  there  should  be  some  ' 

Indlvlduator  of  the  DISTANCE  Concept  with  one  of  Its  Roles  satisfied  by 

: 


{20}  There  Is  a general  problem  here,  of  mixing  recognition  information 
with  more  neutral  descriptive  information.  This  aspect  of  the 
representation  is  currently  under  scrutiny. 

{21}  To  be  precise,  this  use  of  "the"  probably  means  "the  ground  under 
the  arch".  Let  us  assume  that  In  this  world  all  ground  Is  at  the  same 
level,  and  is,  in  fact,  all  one  large  Individual  entity,  and  therefore 
allow  "the  ground"  to  refer  to  that  individual.  Otherwise,  the 
treatment  of  GROUND  would  be  analogous  to  that  of  LINTEL. 
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GROUND.  In  Fig.  18,  we  illustrate  this  partial  state  of  affairs  — D1 


non 


Figure  18.  Partially  specified  DISTANCE. 


is  an  individuator  of  DISTANCE  (indicated  by  the  Individuates  link),  and 
the  fact  that  its  "TO"  Role  (R1)  is  satisfied  is  captured  by  R2,  vdiose 
Satisfies  link  Indicates  the  appropriate  Role,  and  whose  Value  link 
points  to  the  filler.  Now  — back  to  our  English  description  — we  have 
still  to  account  for  "its  lintel"  and  "the  distance".  By  "its",  we  mean 
that  for  each  arch,  there  is  one  lintel,  and  that  is  precisely  what  we 
meant  by  the  Role,  R1,  in  Fig.  17.  The  "the"  with  "distance"  then 
follows  as  saying  that  for  each  instance  of  ARCH,  there  is  one  unique 
distance  involving  the  lintel  of  that  arch.  Thus,  what  we  thought  was 
an  Individuator  of  DISTANCE,  is  not  quite  — it  has  Role  fillers  tied 
down  to  lintels,  but  not  to  a single  constant  one. 


The  fact  that  the  "FROM"  Role  of  D1  is  to  be  "filled"  not  by  a 
constant,  but  by  a type  of  existential,  makes  it  a different  sort  of 
entity  than  R2.  It  is  not  quite  a general  Role,  since  it  can  only  be 
filled  by  the  lintel  of  a particular  arch;  nor  is  it  a filled  Role. 
Instead,  it  is  an  argument  of  a Concept  that  is  parameterized  by  another 
Concept  — D1,  parameterized  by  ARCH.  Once  a particular  arch  is 
selected,  the  filler  of  the  corresponding  DISTANCE'S  "FROM"  Role  is 


.] 

J 

J 

] 
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fixed.  We  call  this  type  of  Concept  a "Parametric  Individual" 
(Paralndividual) , and  express  it  as  in  Fig.  19.  In  this  figure,  the 


^ ^ ^rAlndifiduite^ 


Figure  19.  Paraindividuals  and  Coref  Roles. 

double  'V&l  represents  the  Paralndividual,  which  is  linked  to  DISTANCE 
by  a Para Individuates  link.  The  double  square  is  a "Coref  Role",  which 
equates  (as  coreferential)  the  filler  of  the  "FROM"  role  of  the 
particular  distance  in  some  instance  of  ARCH  with  the  filler  of  the 
"LINTEL"  role  for  that  same  arch.  CorefValue  links  the  equated  Roles, 
and  CorefSatlsfies  performs  an  analogous  task  to  that  of  Satisfies  in  an 
ordinary  filled  Role. 
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3.1.1.  Epistemological  relations  for  structuring  Concepts 


Our  notions  of  Concept,  Role,  and  SD  give  us  the  picture  of 
structured  conceptual  objects  schematically  Illustrated  In  Fig.  20. 

Co‘ 


Qoncepi^ 

SO 


facet 

Figure  20.  Schematic  Concept  structure. 

This  structure  Implies  that  a knowledge  representation  language  that  Is 
based  on  structured  conceptual  objects  must  account  for  at  least  the 
following  relationships: 

1)  the  relationship  between  a Concept  and  one  of  Its  Roles 

2)  the  relationship  between  a Concept  and  one  of  Its  SD's 

3)  the  "Internal  structure  of  a Role  — the  relationship  between  a 
Role  and  one  of  Its  facets 

4)  the  "Internal"  structure  of  an  SD 

5)  relationships  between  parts  of  SD's  and  Roles. 

In  SI -Nets,  we  account  for  these  explicitly  as  link  types,  most  of  which 
were  Illustrated  In  the  above  figures.  Thus,  the  primitives  In  this 
notation  are  epistemological  (knowledge-structuring)  relationships  that 
compose  formal  representational  objects.  It  should  be  clear  at  this 
point  that  there  Is  no  sense  to  having  links  like  "COLOR"  and 
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"ASSAILANT"  in  the  same  formalism  with  links  for  epistemological  ; 

operations  (nor  links  like  "AND"  and  "PRED",  for  that  matter).  The  | 

relationship  between  a Concept  and  a Role/Filler  structure  is  not  the  | 

same  as  that  between  the  object  that  the  Concept  represents  and  the 
thing  that  fills  the  functional  role  for  that  object.  ; 

I 

The  semantics  of  each  of  these  links  is,  of  course,  built  into  the  j 

interpreting  functions  that  operate  over  the  network  structure.  While  I i 

! 

will  not  detail  that  interpreter  here  (except  briefly  — see  Section  ] 

3.U),  it  should  be  noted  that  with  a small,  predetermined  set  of  link  1 

types,  a fixed  interpreter  can,  at  least  in  principle,  be  designed.  In 
languages  that  claim  to  have  no  primitives  at  all,  the  status  of  an 
interpreter  is  in  question{22} . 

3.2.  Epistemological  primitives  for  inheritance 

One  type  of  epistemological  relation  that  we  have  so  far  glossed 
over  is  that  which  connects  formal  objects  of  the  same  type  — Concept 
to  Concept,  Role  to  Role,  and  SD  to  SD.  This  type  of  link  is  a critical 
[ one  in  the  Si-Net  scheme,  since  it  accounts  for  inheritance . For 

' example,  as  mentioned,  individuation  is  a relationship  between  Concepts, 

such  that  there  is  always  some  description  (Concept)  that  is  being 
individuated.  That  Concept  is  composed  of  various  sub-descriptions,  all 
of  which  must  be  satisfied  by  the  individuating  Concept.  Not  only  is 
there  a relation  between  the  two  Concepts  involved  (i.e.  Individuates) . 

, there  is  a set  of  sub-relations  between  the  generalized  attribute 

1 descriptions  (Roles)  of  the  parent  Concept  and  the  values  of  those 

I attributes  in  the  indivlduator  (i.e.  the  relation  Satisfies  expresses 

[ this  in  the  above  examples). 


{22}  See  [Smith  1978]  for  a philosophical  account  of  the  place  and 
nature  of  interpreters  in  knowledge  representation  schemes. 
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The  notion  of  inheritance  is  broader,  however,  than  just  the 
defining  of  an  Individual  Concept  by  a more  general  Generic  Concept. 
"Subconcepts",  themselves  also  Generic,  can  be  formed  from  Generic 
Concepts  by  restricting  some  of  the  subparts  of  the  description  embodied 
by  the  Generic  Concept.  As  we  have  seen  in  the  history  of  semantic 
nets,  the  formation  of  more  and  more  specific  descriptions  is  an 
important  common  feature,  and  taxonomic  hierarchies  depend  on  this  for 
the  backbone  of  their  structure.  There  has  generally  been  a single  link 
(e.g.  "ISA")  to  specify  inheritance  along  sub/superconcept  chains,  and 
the  assumption  has  been  that  everything  relevant  to  a general  class 
(e.g.  MAMMAL)  is  relevant  to  its  more  specific  subclasses  (e.g.  DOG, 
CAT,  etc.).  Looking  at  this  with  our  epistemological  eye,  however,  we 
find  this  to  be  an  oversimplification  of  a multi-faceted  relationship. 

The  Roles  and  SD's  of  a parent  Concept  each  contribute  to  the 
inheritance  of  a subconcept.  Thus  the  inheritance  link  is  effectively  a 
"cable"  carrying  down  each  of  these  to  the  inheritor;  the  Roles  and  SD's 
must  be  transmitted  as  a group,  since  they  do  not  have  an  existence 
independent  of  the  Concept  of  which  they  are  parts.  Just  as  Fahlman's 
"virtual  copy"  link  implies  that  all  parts  of  the  structure  are 
immediately  available  at  a subconcept,  we  think  of  inheritance  as  a 
structured  epistemological  relationship  between  Concepts. 

Further,  properties  are  usually  not  all  inherited  intact,  but 
instead  are  often  modified  so  as  to  give  the  subconcept  a more 
restricted  definition  than  the  parent  Concept{23}.  In  that  case,  each 
of  the  modifications  must  be  represented  in  an  explicit  and  precise  way. 
Figure  21  sketches  the  set  of  epistemological  relations  between  a parent 
Concept  and  one  of  it.:  descendants.  For  each  Role  and  SD  that  is  to  be 
modified  in  some  way,  we  must  say  precisely  what  type  of  modification 
applies,  and  what  Role  or  SD  the  modification  applies  to.  The  latter  is 
indicated  by  an  inter-Role  or  inter-SD  link  stating  the  relationship 


{23}  In  addition,  further  properties  can  be  added  to  form  more 
specialized  Concepts,  e.g.  PRIME-NUMBER  from  NUMBER. 
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Figure  21.  Inter-Concept  structured  inheritance. 

between  the  original  Role  or  SD  and  the  new,  modified  one.  The 
modification  itself  is  then  indicated  just  as  if  the  modifying  Role  were 
a new  Role  description.  KLONE  currently  allows  three  types  of  Role 
modification  (satisfaction,  or  filling;  differentiation,  or  the  creation 
of  sub-roles;  and  restriction  of  the  Role  constraint).  At  the  moment, 
only  one  type  of  SD  modification  (preempting)  is  provided.  These 
relationships  are  explicitly  indicated  by  appropriate  links  with 
unambiguous  Interpretations. 

The  reader  should  consult  [Brachman  1978a]  for  further  details  on 
KLONE.  Here  I have  attempted  only  to  illustrate  the  flavor  of 
relationship  for  which  it  is  necessary  to  account.  More  specifically, 
it  is  the  Job  of  an  epistemological  level  formalism  to  provide  internal 
Concept-,  Role-,  and  SD-structuring  relationships,  and  inheritance- 
specifying  inter-Concept,  inter-Role,  and  inter-SD  relationships. 
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3.3.  The  conceptual  "coat  rack" 

In  many  of  today's  representation  languages,  there  is  a way  for  the 
knowledge  base  designer  to  go  directly  to  the  language  in  which  the 
system  is  implemented  (e.g.  LISP)  in  order  to  express  certain  facts  or 
associate  certain  procedures  with  network  structures.  Such  "escape" 
mechanisms  are  used  either  when  the  knowledge  to  be  expressed  is  too 
complex  to  be  represented  in  the  network  itself,  when  knowledge  about 
the  network  itself  is  to  be  encoded,  or  when  certain  procedures  are  to 
be  triggered  by  operations  on  the  data  base.  With  the  work  of  Brian 
Smith  [1978],  the  epistemological  import  of  "procedural  attachment"  is 
now  clear.  There  are,  according  to  Smith,  two  different  types  of 
attachment  that  are  most  often  confused  under  the  guise  of  "procedural 
attachment":  1)  "meta-description",  wherein  knowledge  about  knowledge  is 
expressed  in  the  same  network  language  as  the  primary  knowledge;  and  2) 
interpretive  intervention,  in  which  direct  instructions  to  the 
interpreter  are  expressed  in  the  language  that  implements  the 
interpreter  itself. 

In  the  case  of  meta-description,  the  interpreter  is  being  asked  to 
make  a type  or  level  jump  when  processing  a Concept{24}. 

Meta-information  is  information  about  a Concept  (or  Role  or  SD)  as  a 
formal  entity,  and  is  not  information  about  the  thing(s)  that  the 
Concept  describes.  To  support  this  kind  of  information,  KLONE  provides 
an  explicit  link  to  a node  representing  a separate  sense  of  the  Concept 
as  a formal  entity.  This  link  is  called  a "metahook",  and  it  can  attach 
to  a Concept,  a Role,  or  an  SD.  Metahooks  always  point  to  Individual 
Concepts,  and  those  Individual  Concepts  express  knowledge  in  the  normal 
KLONE  way  — except  that  their  "referents"  are  formal  entitles  in  the 
net,  and  not  objects  in  the  world. 


{24}  This  is  the  case  in  the  Levesque  and  Mylopoulos  "instance 
hierarchy",  for  example. 
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KLONE  provides  another  kind  of  hook,  the  "interpretive  hook" 

(ihook),  for  attaching  interpreter  code  directly  to  a Concept,  Role,  or 
SD.  The  code  pointed  to  by  an  ihook  must  be  constructed  from 
interpreter  primitives  (e.g.  functions  like  "CreateConcept" , 
"SatisfyRole",  etc.),  and  the  ihook  must  specify  the  place  in  the 
interpreter  from  which  the  code  is  to  be  invoked.  These  hooks  are  not 
intended  as  escapes  in  which  arbitrary  information  can  be  encoded  when 
the  formalism  makes  it  hard  to  express  a fact  about  the  world,  but  as  a 
means  of  direct  advice  to  the  interpreter  with  clear  import{25}. 

The  two  kinds  of  hook  express  important  relationships  between  the 
KLONE  interpreter  and  data  base.  These  relationships  are  different  in 
nature  from  those  expressed  by  the  intensional,  structure-building  links 
discussed  above.  They  allow  us  to  look  at  the  part  of  the  network  built 
out  of  those  links  as  a structure  on  which  to  hang  knowledge  about 
knowledge  or  advice  to  the  interpreter  — as  kind  of  a "conceptual  coat 
rack".  The  knowledge-structuring  relationships  can  be  thought  of  as 
forming  a representation  "plane"  out  of  which  hooks  emerge  orthogonally. 

3.4.  Interpreting  KLONE  structures 

While  I have  given  the  impression  that  there  is  a single  KLONE 
interpreter  that  deals  with  the  node-  and  link-types  described,  that  is 
a bit  misleading.  KLONE  is  Implemented  (in  INTERLISP)  as  a set  of 
interpreter  primitives,  all  of  vdiich  together,  in  some  sense,  form  an 
"interpreter".  However,  these  primitive  functions  for  building, 
accessing,  and  removing  structure  are  not  organized  into  a single 
cohesive  program.  Instead,  they  may  be  used  in  combination  by  higher- 
level  functions  (matching,  reasoning  by  analogy,  deduction,  etc.)  to 
construct  and  maintain  a KLONE  data  base.  Each  function  guarantees 
structural  integrity,  and  the  set  of  functions  together  constitute  the 


{25}  See  [Smith  1978]  for  details  on  the  interaction  of  interpretive 
"planes"  and  meta-descriptive  "layers". 
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only  possible  access  to  the  KLONE  structures.  In  this  way,  Concepts, 
Roles,  and  SD's  are  like  abstract  data  types  in  CLU  [Liskov  and  Zilles 
1974] . The  functional  interface  provides  a clean,  implementation- 
independent  definition  for  the  types  of  entities  that  KLONE  supports. 

The  principal  motivation  for  providing  a set  of  primitive  functional 
pieces  out  of  vrtiich  "higher-level"  procedures  can  be  built,  and  not  a 
particular  set  of  matching,  deduction,  etc.  procedures,  is  that  it  is 
felt  that  we  do  not  have  a clear  enough  understanding  of  these  issues  to 
allow  us  to  provide  powerful  procedures  at  this  higher  level. 

Experience  with  matchers  in  the  field  in  general  has  been  equivocal,  and 
we  have  chosen  instead  to  provide  a basic  set  of  tools  for  building 
different  variants  on  an  experimental  basis.  Since  there  is  no  general 
understanding  of  things  like  matching  and  reasoning  by  analogy,  it  seems 
wise  not  to  commit  the  basic  package  to  some  ad  hoc  set  of  processing 
routines.  This  does  not  mean  to  say,  however,  that  there  do  not  exist 
such  higher-level  routines  for  KLONE  — we  have,  in  fact,  been 
experimenting  with  a variety  of  approaches  to  structure-matching, 
paraphrasing,  question-answering,  and  situation  recognition.  KLONE  is 
well-suited  to  some  of  these  tasks,  and  where  possible,  we  have  provided 
the  obvious  functions.  With  some  of  these  we  are  Investigating  the  use 
of  "parallel"  marker-passing  algorithms  (see  [Woods  and  Brachman  1978], 
for  example). 


The  KLONE  functions  depend  on  the  fact  that  the  set  of  connections 
between  Concepts,  Roles,  and  SD's  is  fixed  in  advance.  In  order  to 
implement,  say,  a function  that  finds  a (possibly  inherited)  facet  of  a 
Role,  we  need  to  be  able  to  anticipate  all  possible  forms  of  Inheritance 
that  will  be  encountered.  The  function  can  then  look  for  immediately 
accessible  values,  and  if  not  found,  can  call  a variant  of  itself 
recursively,  depending  on  the  type  of  Role  inheritance  connector  it 
encounters.  A complete  set  of  Role  inheritance  functions.  Including  the 
provision  for  multiple  superConcepts  and  multiple  superRoles,  has  been 
implemented,  based  on  the  small  set  of  possible  Inter-Role 
relationships. 
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i the  user  of  KLONE  "sees"  only  abstract  structures  for 
Concepts,  etc.,  it  is  not  necessary  for  him/her  to  think  of  the  network 
as  a set  of  nodes  interconnected  by  links,  but  can  instead  view  Concepts 
as  sets  of  Roles  and  SB's,  etc.  The  functions  deal  only  with  those 
entities  (and  their  "epistemological"  relations),  and  never  attempt  to 
make  or  break  simple  local  link-like  connections.  This  is  important, 
considering  that  structured  inheritance  is  a central  feature  of  KLONE;  a 
"cable"  contains  many  connections  that  are  not  independent.  One  problem 
with  the  traditional  semantic  network  metaphor  in  general  is  the 
apparent  independence  of  each  link  from  all  other  links. 

There  are  currently  two  significant  uses  being  made  of  the  KLONE 
interpreter  package.  One  Involves  a natural  language  understanding 
system  that  combines  general  English  ATN-based  parsing  with  the  benefits 
of  "semantic  grammar"  [Brown  and  Burton  1975,  Burton  1976].  A KLONE 
taxonomy  has  been  built  which  encodes  semantic  categories  for  certain 
types  of  phrases,  and  the  parser,  guided  by  a very  general  grammar  of 
English,  interacts  with  this  taxonomy  to  build  up  the  representation  of 
a sentence.  The  Concept-Role  paradigm  is  ideal  for  expressing  the 
relationships  between  categories  like  "person-NP"  and  its  possible 
modifiers,  since  it  provides  a completely  general  case-definition 
facility.  Further,  the  Interpretations  of  sentences  are  built 
incrementally  from  their  syntactic  representations  using  the  Ihook  and 
meta-descrlptlon  facilities  to  map  syntactic  structures  into  those  of  a 
conceptual  network.  The  conceptual  net  expresses  the  relationships 
between  the  entities  discussed  in  the  sentences,  which  at  the  moment, 
include  people,  places,  and  research  topics.  Structural  Descriptions 
play  a large  part  in  handling  paraphrase  utterances  and  determining 
answers  to  queries. 

The  other  domain  to  which  the  package  has  been  applied  is  the 
description  of  general  graphics  knowledge  and  how  to  use  the  display 
facilities  of  a bit-map  terminal.  This  knowledge  includes  coordinate 
system  transformations,  projections  of  entitles  onto  display  surfaces, 
and  Interrelations  between  actual  domain  objects  (like  ships,  land 
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masses,  etc.)  and  their  corresponding  display  forms.  For  example,  one 
might  Incorporate  Into  the  general  knowledge  base  the  desire  to  see 
ships  displayed  as  circles  with  centers  at  their  projected  positions, 
and  augment  that  with  the  Instruction  to  display  ships  with  radar  with  a 
special  symbol.  Once  particular  ships  were  described  to  the  system  (and 
Incorporated  Into  the  portion  of  the  network  dealing  with  domain 
objects),  their  displays  would  be  handled  automatically.  The  knowledge 
Is  encoded  in  KLONE  so  that  It  will  not  only  be  useful  In  producing  the 
displays,  but  will  also  be  available  for  discussion  and  easy 
manipulation  by  the  system's  user. 


Conclusions 

In  this  paper,  I have  examined  the  history  of  the  "semantic" 
network,  looking  for  the  major  conceptual  breakthroughs  that  have  made 
it  such  a popular  representation  technique.  It  was  found  that  through 
that  ten-year  history,  at  least  five  different  Interpretations  of  nodes 
and  links  have  crept  together  to  create  confusing  languages  with  limited 
expressive  power.  In  the  last  two  years,  efforts  have  been  mounted  to 
crack  that  expressive  deadlock;  these  efforts  have  concentrated  on  the 
logical  status  of  network  primitives,  and  have  begun  to  take  a hard  look 
at  the  foundations  of  network  representations.  At  the  same  time,  the 
field  has  begun  to  see  higher-level  structures  (e.g.  partitions,  frames) 
Imposed  on  nodes  and  links.  These  structures  appear  to  be  useful  and 
significant,  but  no  comprehensive  effort  has  been  made  to  understand 
exactly  what  their  status  is. 

In  the  second  section  of  this  paper,  I postulated  a set  of 
conceptual  levels  for  Interpreting  primitives  In  semantic  networks.  The 
four  that  were  immediately  apparent  from  the  history  of  the  semantic  net 
were  the  implementatlonal.  logical . conceptual,  and  linguistic  levels. 
Each  of  these  has  had  at  least  one  (perhaps  Implicit)  proponent  in  the 
literature.  In  addition,  to  account  for  some  more  recent  aspects  of 
knowledge  representation,  and  the  standard  descriptional  use  of  network 


Bolt  Beranek  and  Neviman  Inc. 


concepts,  I proposed  an  Intermediate  level  to  account  for  the  Internal 
structures  of  Concepts,  and  the  relations  of  Inheritance  that  exist 
between  them.  I called  this  the  epistemological  level  of  knowledge 
representation . 

The  third  part  of  the  paper  attempted  to  make  more  apparent  the 
kinds  of  relationships  that  an  epistemological  level  representation 
should  express.  It  was  noted  that  descriptions  of  functional  roles  in 
complex  objects  and  descriptions  of  the  fillers  of  those  roles  were  a 
critical  part  of  knowledge  about  the  world,  and  that,  in  addition,  the 
meaning  of  a functional  role  was  bound  up  in  a set  of  relationships 
between  its  fillers  and  the  fillers  of  other  roles  in  the  object.  Given 
this  interpretation  of  structured  objects,  the  set  of  epistemological 
relations  that  a formalism  must  account  for  becomes  clear.  Finally,  I 
tried  to  illustrate  how  a network  language  might  account  for  all  of 
these  relations  with  explicit  epistemological  links,  and  how  the 
structure  thus  formed  could  be  used  to  hang  information  for  the  network 
interpreter. 

In  conclusion,  it  is  in  general  useful  to  try  to  produce  a knowledge  ^ 

I 

representation  language  that  is  built  on  a small,  fixed  set  of  primitive  1 

node  and  link  types.  Settling  on  a fixed  set  of  primitives,  with  well- 
understood  import  in  terms  of  the  operations  of  a particular  level, 
enables  the  network  designer  to  construct  a well-defined  and  fixed 
interpreter.  In  addition,  consistency  at  a single  level  affords  the 
best  position  from  which  to  achieve  adequacy  toward  the  level  above. 
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